-- Logs begin at Tue 2022-05-17 16:14:38 UTC, end at Tue 2022-05-17 17:27:13 UTC. -- May 17 17:01:26.746185 dv-cinder-842149-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 17 17:01:26.753969 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 17:01:26 2022] *** May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: nodename: dv-cinder-842149-1-iscsi May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: machine: x86_64 May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: clock source: unix May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: pcre jit disabled May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: detected number of CPU cores: 4 May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: current working directory: / May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: detected binary path: /usr/bin/uwsgi-core May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: your processes number limit is 47680 May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: your memory page size is 4096 bytes May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: detected max file descriptor number: 2048 May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: lock engine: pthread robust mutexes May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: thunder lock: enabled May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 17 17:01:26.758875 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 17:01:26.803405 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: Python main interpreter initialized at 0x561c4ffcd9c0 May 17 17:01:26.803405 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: python threads support enabled May 17 17:01:26.803405 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: your server socket listen backlog is limited to 100 connections May 17 17:01:26.803405 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: your mercy for graceful operations on workers is 90 seconds May 17 17:01:26.803819 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: mapped 403077 bytes (393 KB) for 2 cores May 17 17:01:26.803896 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: *** Operational MODE: preforking *** May 17 17:01:26.804123 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: *** uWSGI is running in multiple interpreter mode *** May 17 17:01:26.804123 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: spawned uWSGI master process (pid: 102735) May 17 17:01:26.804325 dv-cinder-842149-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 17 17:01:26.808571 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: spawned uWSGI worker 1 (pid: 102736, cores: 1) May 17 17:01:26.808571 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: spawned uWSGI worker 2 (pid: 102737, cores: 1) May 17 17:01:26.808571 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 17:01:28.005704 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 17:01:28.006346 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 17:01:28.738878 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:01:28.738878 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: from cryptography.utils import int_from_bytes May 17 17:01:28.739195 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:01:28.739195 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: from cryptography.utils import int_from_bytes May 17 17:01:28.739587 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:01:28.739587 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: from cryptography.utils import int_from_bytes May 17 17:01:28.739946 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:01:28.739946 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: from cryptography.utils import int_from_bytes May 17 17:01:31.341607 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 17:01:31.342330 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 17:01:31.342449 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 17:01:31.342806 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 17:01:31.342894 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 17:01:31.342962 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 17:01:31.342962 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 17:01:31.343216 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 17:01:31.343361 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.343525 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 17:01:31.343705 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.343870 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 17:01:31.344029 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.344273 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.344449 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.344581 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.344772 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.344913 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.345089 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.345241 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.345419 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.345578 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.345744 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.345895 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.346076 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.346223 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.346343 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.346550 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.346650 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.346884 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.346980 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842149-1-iscsi {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.347152 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.347288 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.347475 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.347624 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.347832 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842149-1-iscsi {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.347932 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.348162 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.348258 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.348477 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.348572 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.348793 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.348887 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.349120 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.349215 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.349432 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.349625 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.350023 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.350162 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.350278 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.350400 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.350558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.350695 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.350873 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.351060 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.351271 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.351461 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.351682 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.351874 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.352091 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.352281 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.352482 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.352679 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.352874 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.353069 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.353069 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.353402 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.353402 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.353762 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842149-1-iscsi {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.353991 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.354180 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.354490 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.354675 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.354675 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.355036 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842149-1-iscsi {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.355036 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.355418 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.355636 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.355802 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.355973 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.356146 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.356146 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.356395 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.356565 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.356710 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.356843 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.356968 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.357092 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.357293 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.357472 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.357623 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.357765 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.357902 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.358033 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.358166 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.358307 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.358450 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.358619 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.358747 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.358883 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.359015 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.359153 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.359314 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.359447 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.359697 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.359920 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.360117 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.360260 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.360388 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.360522 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.360654 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.360654 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.360910 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.361048 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.361216 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.361378 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.361522 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.361653 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.361789 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.361789 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.362039 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.362172 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.362305 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.362305 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.362553 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.362679 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.362807 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.362930 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.363055 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.363189 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.363322 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.363454 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.363591 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.363760 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.363888 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.364025 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.364158 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.364290 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.364415 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.364539 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.364663 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.364803 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.364943 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.365075 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.365212 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.365344 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.365485 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.365611 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.365745 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.365870 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.366002 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.366134 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.366268 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.366400 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.366533 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.366695 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.366826 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.367043 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.367223 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.367432 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.367567 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.367753 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.367879 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.368011 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.368148 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.368283 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.368416 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.368574 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.368711 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.368883 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.369027 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.369192 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.369328 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.369513 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.369642 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.369831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.369960 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.370137 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.370274 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.370400 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.370525 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.370662 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.370789 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.370969 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.371108 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.371288 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.371418 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.371620 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.371764 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.371924 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.372055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.372231 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.372370 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.372531 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.372668 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.372837 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.372975 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.373144 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.373298 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.373434 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.373558 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.373740 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.373868 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.374044 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.374184 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.374412 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.374588 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.374723 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.374855 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.375508 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.375756 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.375957 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.376176 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.376368 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.376501 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.376627 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.376766 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.376893 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.377026 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.377159 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.377285 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.377435 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.377640 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.377777 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.377912 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.378038 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.378163 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.378293 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.378433 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.378650 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.378780 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.378906 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.379098 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.379235 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.379410 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.379541 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.379764 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.379896 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.380079 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.380210 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.380392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.380536 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.380698 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.380826 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.381017 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.381158 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.381318 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.381446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.381627 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.381764 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.381933 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.382075 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.382246 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.382384 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.382556 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.382684 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.382863 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.383003 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.383173 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.383310 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.383481 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.383640 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.383811 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.383950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.384121 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.384252 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.384429 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.384560 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.384732 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.384864 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.385044 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.385179 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.385351 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.385481 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.385662 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.385791 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.385971 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.386107 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.386279 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.386417 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.386591 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.386730 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.386904 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.387035 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.387231 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:01:31.387362 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.387573 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.387922 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.387922 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.388162 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.388288 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.388431 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.388558 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.388682 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.388867 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.389007 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.389183 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.389328 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.389500 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.389641 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.389829 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.389966 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.390146 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.390289 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.390460 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.391178 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.391386 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.391636 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.391830 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.391961 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.392088 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.392214 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.392339 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.392489 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.392628 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.392765 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.392891 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.393024 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.393203 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.393336 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.393519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.393668 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.393840 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.393979 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.394173 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.394311 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.394499 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.394630 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.394816 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.394954 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.395161 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.395291 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.395510 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.395666 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.395853 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.396000 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.396182 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.396312 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.396508 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.396639 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.396825 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.396963 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.397139 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.397280 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.397454 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.397592 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.397779 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.397988 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.398145 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.398282 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.398409 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.398534 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.398716 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.398851 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.399031 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.399176 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.399346 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.399484 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.399668 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.399797 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.399988 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.400136 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.400303 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.400432 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.400624 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.400762 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.400942 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.401083 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.401260 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.401389 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.401574 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.401712 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.401918 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.402047 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.402187 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.402315 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.402500 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.402630 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.402812 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.402943 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.403119 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.403242 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.403427 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.403564 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.403758 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.403890 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.404069 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.404211 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.404375 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.404504 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.404690 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.404821 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.405002 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.405133 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.405316 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.405437 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.405649 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.405778 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.405956 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.406091 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.406299 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.406504 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.406711 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.406923 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.407116 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.407288 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.407427 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.407566 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.407746 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.407887 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.408031 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.408226 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.408355 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.408502 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.408636 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.408769 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.408895 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.409022 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.409147 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.409282 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.409409 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.409586 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.409717 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.409901 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.410051 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.410229 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.410373 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.410542 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.410671 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.410851 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.410990 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.411161 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.411293 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.411473 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.411628 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.411814 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.411957 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.412133 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.412264 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.412442 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.412570 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.412775 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.412905 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.413096 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.413227 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.413402 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.413531 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.413729 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.413861 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.414055 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.414186 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.414363 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.414491 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.414668 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.414799 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.414981 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.415111 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.415289 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.415419 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.415700 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.415847 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.415975 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.416101 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.416225 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.416361 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.416521 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.416652 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.416829 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.416967 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.417137 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.417277 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.417444 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.417574 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.417750 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.417887 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.418061 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.418214 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.418407 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.418536 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.418670 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.418796 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.418962 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.419101 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.419269 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.419408 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.419577 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.419736 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.419913 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.420053 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.420225 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.420356 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.420575 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.420714 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.420888 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.421020 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.421213 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.421349 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.421529 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.421660 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.421873 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.422046 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.422243 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.422455 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.422665 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.422800 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.422940 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.423093 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.423224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.423418 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.423547 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.423764 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.423911 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.424084 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.424221 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.424395 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.424524 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.424722 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.424852 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.425035 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.425163 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.425356 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.425487 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.425665 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.425803 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.425985 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.426107 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.426304 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.426441 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.426635 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.426779 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.426950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.427080 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.427273 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.427400 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.427587 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.427754 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.427930 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.428061 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.428242 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.428397 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.428600 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.428729 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.428854 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.428980 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.429155 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.429295 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.429478 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.429609 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.429789 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.429920 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.430110 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.430249 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.430422 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.430552 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.430746 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.430884 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.431062 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.431267 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.431396 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.431519 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.431697 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.432082 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.432287 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.432435 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.432611 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.432739 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.432941 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.433072 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.433252 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.433381 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.433566 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.433707 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.433889 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.434028 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.434204 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.434335 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.434517 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.434646 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.434833 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.434961 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.435139 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.435281 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.435448 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.435579 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.435785 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.435916 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.436104 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.436228 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.436413 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.436540 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.436727 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.436869 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.437037 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.437167 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.437356 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.438183 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.438183 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.438610 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.438845 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.438984 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.439112 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.439237 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.439363 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.439499 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.439678 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.439806 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.439932 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.440056 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.440181 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.440320 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.440449 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.440581 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.440707 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.440839 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.440979 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.441130 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.441261 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.441460 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.441592 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.441790 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.441931 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.442126 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.442294 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.442422 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.442603 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.442737 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.442874 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.443031 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.443163 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.443347 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.443478 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.443682 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.443833 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.443997 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.444136 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.444307 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.444444 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.444623 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.444756 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.444933 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.445063 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.445244 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.445374 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.445567 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.445706 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.445880 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.446008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.446191 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.446320 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.446502 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.446641 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.446810 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.446941 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.447120 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.447257 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.447429 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.447560 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.447763 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.447896 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.448066 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.448212 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.448377 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.448506 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.448688 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.448835 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.449029 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.449166 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.449292 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.449416 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.449596 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.449733 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.449917 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.450162 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.450293 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.450498 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.450627 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.450817 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.450953 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.451138 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.451273 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.451456 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.451725 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.451857 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.452067 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.452206 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.452388 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.452523 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.452716 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.452852 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.453054 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.453749 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.453969 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.454198 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.454368 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.454504 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.454630 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.454765 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.454890 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.455073 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.455215 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.455384 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.455513 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.455718 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.455864 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.456031 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.456169 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.456344 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.456473 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.456651 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.456856 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.456994 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.457120 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.457246 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.457377 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.457545 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.457689 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.457862 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.457992 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.458168 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.458298 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.458480 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.458623 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.458795 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.458923 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.459131 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.459277 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.459415 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.459542 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.459717 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.459844 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.460030 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.460160 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.460335 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.460467 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.460652 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.460782 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.460960 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.461090 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.461268 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.461401 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.461577 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.461708 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.461925 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.462056 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.462235 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.462366 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.462541 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.462670 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.462871 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.463011 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.463179 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.463310 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.463486 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.463667 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.463818 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.463966 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.464133 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.464264 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.464445 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.464584 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.464748 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.464888 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.465059 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.465203 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.465390 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.465531 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.465667 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.465803 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.465965 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.466086 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.466268 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.466404 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.466582 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.466720 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.466884 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.467016 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.467239 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.467359 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.467502 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.467672 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.467829 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.467957 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.468135 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.468265 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.468447 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.468578 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.468783 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.468981 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.469231 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.469483 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.469626 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.469756 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.469896 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.470024 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.470150 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.470284 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.470412 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.470539 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.470664 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.470789 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.470916 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.471041 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.471167 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.471299 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.471473 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.471662 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.471792 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.471934 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.472105 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.472237 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.472422 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.472553 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.472740 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.472885 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.473051 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.473172 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.473364 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.473508 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.473672 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.473803 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.473977 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.474116 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.474284 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.474413 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.474602 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.474734 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.474915 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.475047 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.475218 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.475347 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.475530 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.475695 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.475860 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.475992 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.476168 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.476307 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.476473 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.476605 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.476783 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.476915 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.477089 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.477229 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.477393 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.477525 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.477697 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.477836 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.477999 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.478143 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.478304 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.478433 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.478612 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.478753 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.478920 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.479062 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.479224 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.479353 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.479560 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.479728 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.479887 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.480029 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.480205 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.480338 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.480513 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.480651 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.480823 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.480963 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.481131 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.481261 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.481480 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.481619 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.481788 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.481919 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.482149 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.482294 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.482460 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.482591 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.482781 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.482913 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.483086 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.483216 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.483405 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.483536 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.483740 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.483884 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.484057 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.484196 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.484887 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.485067 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.485293 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.485508 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.485692 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.485822 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.485956 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.486164 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.486283 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.486409 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.486534 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.486659 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.486784 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.486927 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.487055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.487188 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.487314 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.487439 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.487663 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.487812 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.487998 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.488130 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.488332 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.488470 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.488646 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.488788 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.488956 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.489089 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.489268 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.489399 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.489580 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.489792 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.489922 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.490055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.490183 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.490316 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.490487 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.490618 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.490797 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.490941 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.491109 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.491232 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.491419 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.491550 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.491758 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.491888 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.492072 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.492203 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.492386 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.492522 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.492694 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.492826 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.493003 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.493147 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.493307 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.493444 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.493620 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.493751 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.493926 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.494070 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.494239 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.494368 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.494551 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.494681 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.494869 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.495011 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.495180 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.495310 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.495544 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.495734 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.495864 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.496001 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.496186 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.496317 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.496504 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.496634 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.496810 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.496941 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.497151 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.497279 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.497473 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.497604 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.497795 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.497927 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.498106 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.498237 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.498414 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.498542 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.498720 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.498851 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.499030 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.499163 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.499356 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.499495 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.499685 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.499829 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.500591 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.500793 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.500982 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.501206 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.501393 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.501534 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.501662 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.501795 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.501922 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.502057 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.502235 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.502367 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.502551 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.502682 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.502860 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.503005 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.503249 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.503379 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.503590 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.503782 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.503909 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.504050 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.504240 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.504380 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.504564 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.504728 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.504891 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.505035 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.505200 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.505355 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.505520 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.505685 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.505827 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.506016 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.506165 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.506346 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.506490 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.506659 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.506804 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.506983 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.507127 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.507301 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.507464 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.507658 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.507791 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.507993 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.508138 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.508310 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.508439 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.508631 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.508760 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.508943 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.509084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.509274 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.509414 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.509604 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.509745 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.509925 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.510080 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.510274 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.510405 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.510570 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.510701 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.510876 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.511017 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.511189 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.511320 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.511497 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.511667 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.511817 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.511954 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.512146 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.512278 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.512455 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.512594 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.512770 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.512903 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.513090 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.513220 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.513401 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.513547 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.513708 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.513841 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.514015 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.514147 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.514339 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.514479 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.514644 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.514775 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.514955 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.515084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.515265 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.515406 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.515624 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.515804 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.516008 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.516218 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.516400 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.516545 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.516673 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.516807 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.516935 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.517061 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.517205 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.517346 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.517473 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.517680 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.517811 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.517993 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.518136 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.518323 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.518462 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.518640 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.518771 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.518949 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.519091 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.519260 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.519398 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.519571 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.519725 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.519938 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.520079 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.520326 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.520464 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.520591 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.520715 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.520882 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.521015 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.521209 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.521339 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.521516 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.521655 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.521822 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.521961 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.522133 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.522266 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.522441 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.522583 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.522748 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.522880 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.523058 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.523189 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.523369 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.523510 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.523697 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.523831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.524004 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.524145 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.524307 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.524452 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.524625 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.524761 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.524930 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.525059 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.525241 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.525381 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.525551 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.525681 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.525854 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.525989 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.526160 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.526334 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.526472 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.526598 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.526786 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.526915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.527092 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.527222 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.527420 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.527549 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.527755 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.527887 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.528069 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.528202 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.528379 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.528511 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.528695 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.528823 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.529020 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.529160 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.529339 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.529471 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.529657 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.529786 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.529975 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.530113 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.530290 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.530497 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.530628 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.530753 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.530894 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.531023 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.531336 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.531525 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.531801 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.532021 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.532157 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.532284 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.532410 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.532543 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.532672 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.532811 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.532939 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.533129 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.533261 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.533462 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.533597 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.533808 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.533945 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.534072 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.534198 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.534383 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.534515 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.534699 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.534994 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.535125 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.535311 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.535440 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.535640 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.535775 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.535980 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.536110 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.536301 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.536433 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.536623 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.536762 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.536944 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.537085 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.537263 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.537395 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.537583 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.537722 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.537901 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.538033 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.538218 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.538356 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.538541 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.538671 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.538859 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.538992 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.539189 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.539329 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.539531 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.539705 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.539865 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.539995 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.540183 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.540316 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.540543 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.540681 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.540809 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.540942 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.541148 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.541277 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.541406 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.541532 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.541712 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.541852 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.542027 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.542208 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.542336 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.542470 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.542637 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.542778 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.542957 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.543095 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.543273 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.543404 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.543619 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.543771 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.543948 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.544078 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.544266 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.544398 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.544582 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.544724 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.544900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.545039 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.545217 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.545348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.545549 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.545733 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.545892 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.546053 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.546220 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.546388 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.546534 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.546715 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.547373 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.547581 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.547819 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.547987 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.548225 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.548402 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.548543 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.548731 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.548863 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.549075 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.549215 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.549412 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.549545 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.549739 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.549868 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.550047 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.550179 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.550371 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.550502 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.550712 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.550850 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.550987 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.551144 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.551280 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.551407 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.551589 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.551750 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.551943 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.552143 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.552275 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.552490 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.552629 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.552811 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.552944 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.553139 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.553277 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.553475 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.553606 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.553789 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.553920 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.554098 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.554331 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.554462 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.554687 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.554828 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.555013 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.555152 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.555329 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.555466 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.555675 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.555810 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.555987 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.556130 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.556295 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.556427 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.556609 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.556749 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.557182 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.557321 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.557489 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.557620 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.557803 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.557936 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.558110 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.558241 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.558418 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.558554 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.558729 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.558861 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.559032 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.559162 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.559337 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.559481 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.559647 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.559775 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.559965 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.560095 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.560274 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.560417 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.560579 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.560710 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.560921 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.561052 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.561179 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.561319 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.561473 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.561605 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.561783 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.561913 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.562088 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.562234 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.562397 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.563273 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.563481 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.563738 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.563946 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.564172 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.564374 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.564597 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.564805 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.564951 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.565090 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.565238 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.565367 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.565501 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.565635 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.565762 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.565898 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.566025 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.566151 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.566278 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.566403 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.566536 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.566674 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.566809 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.566949 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.567076 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.567202 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.567329 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.567469 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.567593 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.567782 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.567923 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.568052 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.568188 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.568357 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.568521 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.568676 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.568856 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.569029 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.569171 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.569355 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.569486 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.569752 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.569881 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.570223 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.570395 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.570528 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.570710 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.570841 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.571066 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.571198 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.571325 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.571482 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.571635 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.571823 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.572040 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.572170 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.572306 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.572434 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.572561 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.572757 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.572902 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.573076 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.573216 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.573392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.573523 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.573710 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.573851 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.574027 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.574158 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.574347 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.574486 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.574669 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.574804 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.574977 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.575122 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.575293 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.575424 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.575648 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.575796 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.575932 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.576065 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.576238 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.576370 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.576553 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.576693 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.576876 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.577007 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.577195 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.577336 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.577525 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.577654 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.577841 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.577970 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.578174 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.578383 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.578581 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.578808 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.578995 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.579126 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.579261 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.579399 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.579527 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.579673 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.579835 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.579967 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.580161 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.580303 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.580487 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.580618 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.580798 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.580930 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.581205 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.581352 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.581523 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.581653 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.581850 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.581980 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.582194 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.582332 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.582495 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.582626 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.582820 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.582960 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.583132 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.583282 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.583445 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.583584 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.583774 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.583920 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.584090 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.584221 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.584412 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.584542 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.584726 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.584866 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.585032 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.585164 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.585338 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.585468 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.585649 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.585781 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.585954 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.586085 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.586262 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.586400 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.586569 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.586702 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.586873 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.587004 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.587185 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.587316 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.587489 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.587650 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.587817 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.587948 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.588124 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.588257 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.588431 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.588564 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.588736 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.588875 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.589040 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.589181 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.589349 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.589478 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.589653 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.589790 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.589959 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.590098 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.590262 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.590392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.590569 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.590698 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.590872 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.591010 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.591179 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.591385 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.591524 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.591686 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.591815 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.591955 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.592113 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.592245 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.592470 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.592608 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.592746 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.592874 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.593033 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.593164 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.593343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.593474 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.593703 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.593893 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.594102 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.594279 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.594409 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.594543 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.594681 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.594810 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.594978 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.595109 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.595305 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.595436 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.595640 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.595777 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.595974 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.596114 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.596300 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.596441 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.596612 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.596743 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.596927 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.597056 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.597255 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.597395 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.597564 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.597698 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.597881 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.598011 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.598198 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.598340 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.598516 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.598647 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.598833 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.598962 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.599145 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.599277 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.599474 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.599625 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.599824 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.599953 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.600134 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.600265 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.600450 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.600600 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.600762 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.600893 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.601095 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.601225 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.601366 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.601561 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.601690 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.601826 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.602001 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.602132 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.602328 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.602464 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.602640 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.602779 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.602959 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.603088 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.603276 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.603407 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.603593 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.603805 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.603935 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.604063 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.604256 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.604386 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.604590 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.604731 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.604914 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.605044 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.605228 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.605356 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.605533 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.605664 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.605790 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 17:01:31.605917 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.606224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.606543 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.606896 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.607233 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.607553 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.607898 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.608213 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:01:31.608463 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 17:01:31.629876 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG oslo_db.sqlalchemy.engines [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:01:31.632052 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_db.sqlalchemy.engines [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:01:31.694117 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.context [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5cb3f3d-542a-485b-8bb4-94fae1d56923(cell1) {{(pid=102737) load_cells /opt/stack/nova/nova/context.py:464}} May 17 17:01:31.696529 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.context [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5cb3f3d-542a-485b-8bb4-94fae1d56923(cell1) {{(pid=102736) load_cells /opt/stack/nova/nova/context.py:464}} May 17 17:01:31.698444 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG oslo_concurrency.lockutils [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:01:31.700016 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG oslo_concurrency.lockutils [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:01:31.700805 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG oslo_concurrency.lockutils [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:01:31.700897 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:01:31.702397 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:01:31.702736 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG oslo_concurrency.lockutils [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:01:31.703225 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:01:31.705271 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:01:31.714914 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG oslo_db.sqlalchemy.engines [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:01:31.718281 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_db.sqlalchemy.engines [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:01:31.721816 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_db.sqlalchemy.engines [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:01:31.862612 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG oslo_db.sqlalchemy.engines [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:01:31.881692 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_db.sqlalchemy.engines [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:01:31.885473 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG oslo_db.sqlalchemy.engines [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:01:32.224672 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: WARNING keystonemiddleware.auth_token [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:01:32.225283 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: WARNING keystonemiddleware.auth_token [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:01:32.231977 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: WARNING keystonemiddleware.auth_token [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:01:32.232608 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: WARNING keystonemiddleware.auth_token [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:01:32.576782 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: WARNING keystonemiddleware.auth_token [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:01:32.577924 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: WARNING keystonemiddleware.auth_token [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:01:32.583427 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: WARNING keystonemiddleware.auth_token [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:01:32.585329 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: WARNING keystonemiddleware.auth_token [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:01:32.589535 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561c4ffcd9c0 pid: 102737 (default app) May 17 17:01:32.591561 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561c4ffcd9c0 pid: 102736 (default app) May 17 17:01:32.591678 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:01:32.592783 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-c7c4f026-a495-4d8e-97ac-281e2c24581b None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 May 17 17:01:32.593183 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Tue May 17 17:01:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:02:50.633258 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:02:50.634457 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001908 May 17 17:02:50.634864 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 17 17:02:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:02:51.047590 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-7c5c3e2c-d661-450d-9e84-8c24889c03dd admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:02:51.078473 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-7c5c3e2c-d661-450d-9e84-8c24889c03dd admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.437380 May 17 17:02:51.079292 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 2/3] 10.222.0.48 () {60 vars in 1291 bytes} [Tue May 17 17:02:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:02:53.382890 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:02:53.383929 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-379b37ee-a3f1-426c-88b2-ee6274fdf50d None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 17 17:02:53.384485 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 2/4] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 17 17:02:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:02:53.446796 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-d0fc704f-689a-4f7e-91ff-92d2c2ec7e8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:02:53.465038 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:02:53.465038 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: warnings.warn(msg) May 17 17:02:53.493678 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-d0fc704f-689a-4f7e-91ff-92d2c2ec7e8c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102767 May 17 17:02:53.494562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 3/5] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 17 17:02:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:02:53.709313 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-271e5839-fae1-46a2-9714-c7a7860c9058 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:02:53.711794 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:02:53.711794 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: warnings.warn(msg) May 17 17:02:53.761889 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-271e5839-fae1-46a2-9714-c7a7860c9058 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.257946 May 17 17:02:53.774422 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 3/6] 10.222.0.48 () {64 vars in 1335 bytes} [Tue May 17 17:02:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:02:56.036463 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-d0fc704f-689a-4f7e-91ff-92d2c2ec7e8c admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:02:56.038139 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-d0fc704f-689a-4f7e-91ff-92d2c2ec7e8c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002242 May 17 17:02:56.038766 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 4/7] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 17 17:02:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:02:56.156363 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-94e898dc-8c10-4868-9eaf-1f17d5abb375 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "swap": 0, "disk": 5}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:02:56.174155 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:02:56.174155 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: warnings.warn(msg) May 17 17:02:56.192931 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-94e898dc-8c10-4868-9eaf-1f17d5abb375 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144144 May 17 17:02:56.193471 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 4/8] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 17 17:02:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:02:56.205724 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-84c679dd-465a-4f5a-8ee8-163c623b0996 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:02:56.207199 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:02:56.207199 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: warnings.warn(msg) May 17 17:02:56.238175 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-84c679dd-465a-4f5a-8ee8-163c623b0996 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036094 May 17 17:02:56.238745 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 5/9] 10.222.0.48 () {64 vars in 1335 bytes} [Tue May 17 17:02:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:02:58.497237 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-94e898dc-8c10-4868-9eaf-1f17d5abb375 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:02:58.498251 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-94e898dc-8c10-4868-9eaf-1f17d5abb375 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 17 17:02:58.498654 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 17 17:02:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:02:58.558839 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-933e1125-9449-4b43-889e-d7b27d5fe780 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:02:58.579634 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-933e1125-9449-4b43-889e-d7b27d5fe780 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074597 May 17 17:02:58.587185 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 6/11] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 17 17:02:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:02:58.593449 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-420d5d4e-d53e-4a06-832b-c31db934b046 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:02:58.617342 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-420d5d4e-d53e-4a06-832b-c31db934b046 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027813 May 17 17:02:58.618638 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 6/12] 10.222.0.48 () {64 vars in 1335 bytes} [Tue May 17 17:02:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:03:00.909591 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-933e1125-9449-4b43-889e-d7b27d5fe780 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:00.910608 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-933e1125-9449-4b43-889e-d7b27d5fe780 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 May 17 17:03:00.911031 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 7/13] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 17 17:03:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:00.972159 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-83e670d4-6f98-41f8-ae1e-208876c4d030 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:00.990028 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-83e670d4-6f98-41f8-ae1e-208876c4d030 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072511 May 17 17:03:00.990595 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 7/14] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 17 17:03:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:03:01.002926 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-5c8361c2-0b3d-454d-a7f0-3840a8d22241 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:01.028128 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-5c8361c2-0b3d-454d-a7f0-3840a8d22241 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028751 May 17 17:03:01.028892 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 8/15] 10.222.0.48 () {64 vars in 1335 bytes} [Tue May 17 17:03:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:03:03.328648 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-83e670d4-6f98-41f8-ae1e-208876c4d030 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:03.329671 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-83e670d4-6f98-41f8-ae1e-208876c4d030 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 17 17:03:03.330070 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 8/16] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 17 17:03:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:03.391902 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-19637911-c14c-454a-abe3-a915aace82a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "disk": 20}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:03.410577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-19637911-c14c-454a-abe3-a915aace82a1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074696 May 17 17:03:03.411314 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 9/17] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 17 17:03:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:03:03.423396 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-dc62aabf-f6f0-4bd6-bc13-d96eeb5c1096 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:03.446392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-dc62aabf-f6f0-4bd6-bc13-d96eeb5c1096 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026497 May 17 17:03:03.448184 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 9/18] 10.222.0.48 () {64 vars in 1335 bytes} [Tue May 17 17:03:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:03:05.759562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-19637911-c14c-454a-abe3-a915aace82a1 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:05.760784 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-19637911-c14c-454a-abe3-a915aace82a1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 May 17 17:03:05.761741 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 10/19] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 17 17:03:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:05.823514 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-a09bc73a-76c3-47bd-9dc0-ce7c5ba6dcf1 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:05.848085 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-a09bc73a-76c3-47bd-9dc0-ce7c5ba6dcf1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079465 May 17 17:03:05.848798 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 10/20] 10.222.0.48 () {60 vars in 1291 bytes} [Tue May 17 17:03:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:03:08.105904 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-19637911-c14c-454a-abe3-a915aace82a1 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:08.106966 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-19637911-c14c-454a-abe3-a915aace82a1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 May 17 17:03:08.107397 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 11/21] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 17 17:03:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:08.169202 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-36372505-1edf-448a-975c-c7525aa750ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:08.187017 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-36372505-1edf-448a-975c-c7525aa750ef admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073527 May 17 17:03:08.187638 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 11/22] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 17 17:03:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:03:08.200682 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-40a253c2-7ee4-4665-b96e-d37ad6edf7b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:08.224444 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-40a253c2-7ee4-4665-b96e-d37ad6edf7b9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028373 May 17 17:03:08.225038 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 12/23] 10.222.0.48 () {64 vars in 1332 bytes} [Tue May 17 17:03:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:03:11.093128 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-36372505-1edf-448a-975c-c7525aa750ef admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:11.094140 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-36372505-1edf-448a-975c-c7525aa750ef admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 17 17:03:11.094554 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 17 17:03:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:11.164996 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-95dab6da-baa8-4004-bb99-73b3c78d0685 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "disk": 20}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:11.185512 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-95dab6da-baa8-4004-bb99-73b3c78d0685 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083551 May 17 17:03:11.186192 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 13/25] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 17 17:03:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:03:11.197869 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-28c4486d-bba5-4726-a87c-9fe4d0a26347 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:11.220667 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-28c4486d-bba5-4726-a87c-9fe4d0a26347 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026382 May 17 17:03:11.221252 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 13/26] 10.222.0.48 () {64 vars in 1332 bytes} [Tue May 17 17:03:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:03:13.641228 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-95dab6da-baa8-4004-bb99-73b3c78d0685 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:13.642261 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-95dab6da-baa8-4004-bb99-73b3c78d0685 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 17 17:03:13.642667 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 14/27] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 17 17:03:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:13.700703 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-7202e5dd-1bdd-4c32-859d-eaa478461fa3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "swap": 0, "name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:13.717950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-7202e5dd-1bdd-4c32-859d-eaa478461fa3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069512 May 17 17:03:13.718491 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 14/28] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 17 17:03:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:03:13.731068 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6de47fae-c29f-4cac-94e5-411573015e52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:13.753959 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6de47fae-c29f-4cac-94e5-411573015e52 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027261 May 17 17:03:13.754711 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 15/29] 10.222.0.48 () {64 vars in 1332 bytes} [Tue May 17 17:03:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:03:16.112159 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-7202e5dd-1bdd-4c32-859d-eaa478461fa3 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:16.113183 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-7202e5dd-1bdd-4c32-859d-eaa478461fa3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 May 17 17:03:16.113586 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 15/30] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 17 17:03:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:16.171451 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6b64ebe0-3c6a-46d8-92cd-30a5a9ee6bf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:16.191971 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6b64ebe0-3c6a-46d8-92cd-30a5a9ee6bf4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072242 May 17 17:03:16.192975 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 16/31] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 17 17:03:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:03:16.204979 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-abdc1dc0-100a-4b16-ac30-09e6f8852f14 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:16.232139 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-abdc1dc0-100a-4b16-ac30-09e6f8852f14 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030787 May 17 17:03:16.232967 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 16/32] 10.222.0.48 () {64 vars in 1332 bytes} [Tue May 17 17:03:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:03:18.575286 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6b64ebe0-3c6a-46d8-92cd-30a5a9ee6bf4 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:18.576348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6b64ebe0-3c6a-46d8-92cd-30a5a9ee6bf4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 17 17:03:18.576748 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 17/33] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 17 17:03:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:18.640546 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-cdabee31-5956-4129-b7a8-5f394e60c949 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "disk": 160, "vcpus": 8}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:18.662289 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-cdabee31-5956-4129-b7a8-5f394e60c949 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079596 May 17 17:03:18.663257 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 17/34] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 17 17:03:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:03:18.677182 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-178e4749-d9fe-4f9e-aae4-40b9c9a1ab11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:18.703643 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-178e4749-d9fe-4f9e-aae4-40b9c9a1ab11 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032495 May 17 17:03:18.705089 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 18/35] 10.222.0.48 () {64 vars in 1332 bytes} [Tue May 17 17:03:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:03:42.554194 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-cdabee31-5956-4129-b7a8-5f394e60c949 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:42.555793 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-cdabee31-5956-4129-b7a8-5f394e60c949 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001969 May 17 17:03:42.556195 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 18/36] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 17 17:03:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:42.611958 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-2d4bea31-5e6d-4e61-9814-f672f12c8a43 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:42.631709 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-2d4bea31-5e6d-4e61-9814-f672f12c8a43 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069662 May 17 17:03:42.632256 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 19/37] 10.222.0.48 () {60 vars in 1291 bytes} [Tue May 17 17:03:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:03:43.638453 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-cdabee31-5956-4129-b7a8-5f394e60c949 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:43.639466 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-cdabee31-5956-4129-b7a8-5f394e60c949 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 17 17:03:43.639907 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 19/38] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 17 17:03:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:43.835618 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-5f0447c3-27d5-4b8b-8f16-04fc33488a7c admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:43.841740 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.wsgi [None req-5f0447c3-27d5-4b8b-8f16-04fc33488a7c admin admin] HTTP exception thrown: Flavor 42 could not be found. May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-5f0447c3-27d5-4b8b-8f16-04fc33488a7c admin admin] Request method failure captured: May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Accept: application/json May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Accept-Encoding: gzip, deflate May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Connection: keep-alive May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Content-Length: 0 May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Host: 10.222.0.48 May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Openstack-Api-Version: compute 2.90 May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Openstack-System-Scope: None May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: User-Agent: python-novaclient May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Auth-Token: gAAAAABig9Vv4j4XMoQ3yzZ28azkq26u8J3so1FgxNUSA0thL-oSR3mkeVdZe-tViYSh9mYCKry2H6RH8nza_EUwoqwUn61e53txfMtHJ7iDldW_ZHpuljmstHlEVaGWrC4ksYTREWxgG_jkvxYek_NS7pa3lbQWLEoWG_5w0oMkiHaZMwRgsVQ May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Domain-Id: None May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Domain-Name: None May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Identity-Status: Confirmed May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Is-Admin-Project: True May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Openstack-Nova-Api-Version: 2.90 May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Project-Domain-Id: default May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Project-Domain-Name: Default May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Project-Id: 3a3ee3f323ac4b12815e2057e52b4ed6 May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Project-Name: admin May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Role: admin,member,reader May 17 17:03:43.844968 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Roles: admin,member,reader May 17 17:03:43.846577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:03:43.846577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Tenant: admin May 17 17:03:43.846577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Tenant-Id: 3a3ee3f323ac4b12815e2057e52b4ed6 May 17 17:03:43.846577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Tenant-Name: admin May 17 17:03:43.846577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User: admin May 17 17:03:43.846577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User-Domain-Id: default May 17 17:03:43.846577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User-Domain-Name: Default May 17 17:03:43.846577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User-Id: f95fdce949f547f29f3329fa96fe74ac May 17 17:03:43.846577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User-Name: admin May 17 17:03:43.846577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: method: > May 17 17:03:43.846577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: exception: Flavor 42 could not be found. May 17 17:03:43.846577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: action_args: {'id': '42'} May 17 17:03:43.846577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:03:43.846577 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:03:43.847546 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:43.849084 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-5f0447c3-27d5-4b8b-8f16-04fc33488a7c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:03:43.850367 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-5f0447c3-27d5-4b8b-8f16-04fc33488a7c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062445 May 17 17:03:43.850367 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 20/39] 10.222.0.48 () {60 vars in 1190 bytes} [Tue May 17 17:03:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 17:03:43.856780 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-0a578795-d5c4-4061-9a7c-c0fcdddfd190 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:43.878295 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-0a578795-d5c4-4061-9a7c-c0fcdddfd190 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025104 May 17 17:03:43.878834 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 20/40] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 17 17:03:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:03:43.894234 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-bdcee139-594e-49b9-8f2d-8d41b48904c1 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:43.917572 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-bdcee139-594e-49b9-8f2d-8d41b48904c1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026910 May 17 17:03:43.918111 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 21/41] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 17 17:03:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:03:43.927293 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-2df90e4b-4e8b-4d9a-a955-5e676724752f admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:43.933274 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.wsgi [None req-2df90e4b-4e8b-4d9a-a955-5e676724752f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-2df90e4b-4e8b-4d9a-a955-5e676724752f admin admin] Request method failure captured: May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Accept: application/json May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Accept-Encoding: gzip, deflate May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Connection: keep-alive May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Content-Length: 0 May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Host: 10.222.0.48 May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Openstack-Api-Version: compute 2.90 May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Openstack-System-Scope: None May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: User-Agent: python-novaclient May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Auth-Token: gAAAAABig9Vv4j4XMoQ3yzZ28azkq26u8J3so1FgxNUSA0thL-oSR3mkeVdZe-tViYSh9mYCKry2H6RH8nza_EUwoqwUn61e53txfMtHJ7iDldW_ZHpuljmstHlEVaGWrC4ksYTREWxgG_jkvxYek_NS7pa3lbQWLEoWG_5w0oMkiHaZMwRgsVQ May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Domain-Id: None May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Domain-Name: None May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Identity-Status: Confirmed May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Is-Admin-Project: True May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Openstack-Nova-Api-Version: 2.90 May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Project-Domain-Id: default May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Project-Domain-Name: Default May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Project-Id: 3a3ee3f323ac4b12815e2057e52b4ed6 May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Project-Name: admin May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Role: admin,member,reader May 17 17:03:43.936558 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Roles: admin,member,reader May 17 17:03:43.938055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:03:43.938055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Tenant: admin May 17 17:03:43.938055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Tenant-Id: 3a3ee3f323ac4b12815e2057e52b4ed6 May 17 17:03:43.938055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Tenant-Name: admin May 17 17:03:43.938055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User: admin May 17 17:03:43.938055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User-Domain-Id: default May 17 17:03:43.938055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User-Domain-Name: Default May 17 17:03:43.938055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User-Id: f95fdce949f547f29f3329fa96fe74ac May 17 17:03:43.938055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User-Name: admin May 17 17:03:43.938055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: method: > May 17 17:03:43.938055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: exception: Flavor 42 could not be found. May 17 17:03:43.938055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: action_args: {'id': '42'} May 17 17:03:43.938055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:03:43.938055 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:03:43.938988 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:43.940446 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-2df90e4b-4e8b-4d9a-a955-5e676724752f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:03:43.941680 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-2df90e4b-4e8b-4d9a-a955-5e676724752f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014161 May 17 17:03:43.941680 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 21/42] 10.222.0.48 () {60 vars in 1190 bytes} [Tue May 17 17:03:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 17:03:44.839223 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-bdcee139-594e-49b9-8f2d-8d41b48904c1 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:44.840890 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-bdcee139-594e-49b9-8f2d-8d41b48904c1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002172 May 17 17:03:44.841508 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 22/43] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 17 17:03:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:45.078899 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-eb4cc044-b438-4979-bc4b-38f29df50ad2 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:45.084207 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.wsgi [None req-eb4cc044-b438-4979-bc4b-38f29df50ad2 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-eb4cc044-b438-4979-bc4b-38f29df50ad2 admin admin] Request method failure captured: May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Accept: application/json May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Accept-Encoding: gzip, deflate May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Connection: keep-alive May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Content-Length: 0 May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Host: 10.222.0.48 May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Openstack-Api-Version: compute 2.90 May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Openstack-System-Scope: None May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: User-Agent: python-novaclient May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Auth-Token: gAAAAABig9VwcwgbRQT_rPcWtqFEXet5eZRDStO1VhgQ9pMjRSg1D2l665QJCy9yq41X3V7pT5fE3IPJOUUkF40LMT_urGV1otL5O_hkXWw_kZ8eVwHkzy4_8bsh-aDSJRgxTu26zM5QPnb4Qu3LuFVO7A3N8U2e2gquGXQbXrKtKV9lHk3LA7Y May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Domain-Id: None May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Domain-Name: None May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Identity-Status: Confirmed May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Is-Admin-Project: True May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Openstack-Nova-Api-Version: 2.90 May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Project-Domain-Id: default May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Project-Domain-Name: Default May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Project-Id: 3a3ee3f323ac4b12815e2057e52b4ed6 May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Project-Name: admin May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Role: admin,member,reader May 17 17:03:45.086008 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Roles: admin,member,reader May 17 17:03:45.087392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:03:45.087392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Tenant: admin May 17 17:03:45.087392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Tenant-Id: 3a3ee3f323ac4b12815e2057e52b4ed6 May 17 17:03:45.087392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Tenant-Name: admin May 17 17:03:45.087392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User: admin May 17 17:03:45.087392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User-Domain-Id: default May 17 17:03:45.087392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User-Domain-Name: Default May 17 17:03:45.087392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User-Id: f95fdce949f547f29f3329fa96fe74ac May 17 17:03:45.087392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User-Name: admin May 17 17:03:45.087392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: method: > May 17 17:03:45.087392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: exception: Flavor 84 could not be found. May 17 17:03:45.087392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: action_args: {'id': '84'} May 17 17:03:45.087392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:03:45.087392 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:03:45.088224 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:45.089364 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-eb4cc044-b438-4979-bc4b-38f29df50ad2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:03:45.090374 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-eb4cc044-b438-4979-bc4b-38f29df50ad2 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065414 May 17 17:03:45.090374 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 22/44] 10.222.0.48 () {60 vars in 1190 bytes} [Tue May 17 17:03:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 17:03:45.099864 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-380761fe-ac35-4470-b7e2-88a5d281c63d admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:45.121933 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-380761fe-ac35-4470-b7e2-88a5d281c63d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025564 May 17 17:03:45.122502 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 23/45] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 17 17:03:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:03:45.133750 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-cc7ac4ad-838c-4b42-8ed4-8cbc322a1ba3 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:45.152944 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-cc7ac4ad-838c-4b42-8ed4-8cbc322a1ba3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023499 May 17 17:03:45.153901 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 23/46] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 17 17:03:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:03:45.166816 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-5bca6ec4-7319-4438-a5c1-e3dd0799129d admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:45.173358 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.wsgi [None req-5bca6ec4-7319-4438-a5c1-e3dd0799129d admin admin] HTTP exception thrown: Flavor 84 could not be found. May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-5bca6ec4-7319-4438-a5c1-e3dd0799129d admin admin] Request method failure captured: May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Accept: application/json May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Accept-Encoding: gzip, deflate May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Connection: keep-alive May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Content-Length: 0 May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Host: 10.222.0.48 May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Openstack-Api-Version: compute 2.90 May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Openstack-System-Scope: None May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: User-Agent: python-novaclient May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Auth-Token: gAAAAABig9VwcwgbRQT_rPcWtqFEXet5eZRDStO1VhgQ9pMjRSg1D2l665QJCy9yq41X3V7pT5fE3IPJOUUkF40LMT_urGV1otL5O_hkXWw_kZ8eVwHkzy4_8bsh-aDSJRgxTu26zM5QPnb4Qu3LuFVO7A3N8U2e2gquGXQbXrKtKV9lHk3LA7Y May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Domain-Id: None May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Domain-Name: None May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Identity-Status: Confirmed May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Is-Admin-Project: True May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Openstack-Nova-Api-Version: 2.90 May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Project-Domain-Id: default May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Project-Domain-Name: Default May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Project-Id: 3a3ee3f323ac4b12815e2057e52b4ed6 May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Project-Name: admin May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Role: admin,member,reader May 17 17:03:45.174875 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Roles: admin,member,reader May 17 17:03:45.176519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:03:45.176519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Tenant: admin May 17 17:03:45.176519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Tenant-Id: 3a3ee3f323ac4b12815e2057e52b4ed6 May 17 17:03:45.176519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Tenant-Name: admin May 17 17:03:45.176519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User: admin May 17 17:03:45.176519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User-Domain-Id: default May 17 17:03:45.176519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User-Domain-Name: Default May 17 17:03:45.176519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User-Id: f95fdce949f547f29f3329fa96fe74ac May 17 17:03:45.176519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User-Name: admin May 17 17:03:45.176519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: method: > May 17 17:03:45.176519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: exception: Flavor 84 could not be found. May 17 17:03:45.176519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: action_args: {'id': '84'} May 17 17:03:45.176519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:03:45.176519 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:03:45.177562 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:45.179160 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-5bca6ec4-7319-4438-a5c1-e3dd0799129d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:03:45.181250 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-5bca6ec4-7319-4438-a5c1-e3dd0799129d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014033 May 17 17:03:45.181250 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 24/47] 10.222.0.48 () {60 vars in 1190 bytes} [Tue May 17 17:03:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 17:03:46.095979 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-cc7ac4ad-838c-4b42-8ed4-8cbc322a1ba3 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:46.097027 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-cc7ac4ad-838c-4b42-8ed4-8cbc322a1ba3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 17 17:03:46.097422 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 24/48] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 17 17:03:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:46.284199 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-2d4c1179-a7ce-43c1-af8b-c7a36461d52a admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:46.289871 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.wsgi [None req-2d4c1179-a7ce-43c1-af8b-c7a36461d52a admin admin] HTTP exception thrown: Flavor 451 could not be found. May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-2d4c1179-a7ce-43c1-af8b-c7a36461d52a admin admin] Request method failure captured: May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Accept: application/json May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Accept-Encoding: gzip, deflate May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Connection: keep-alive May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Content-Length: 0 May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Host: 10.222.0.48 May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Openstack-Api-Version: compute 2.90 May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Openstack-System-Scope: None May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: User-Agent: python-novaclient May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Auth-Token: gAAAAABig9VyKWv3fqUeFmvnT3tBfLL-DOJZAuz87_jkIUTNDjyb2wPtUeygZESELGvqS_LBk2HnLfMpCpI5xAULOgtA_4g_IPaWmwBVqWfjw61Dh97B2A_uKDTGjDGOJM1ye1nrO-TegrFUCp_Qqy8PX-d_2_pDavfrG5ruT3q4hlsTGcqnxbs May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Domain-Id: None May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Domain-Name: None May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Identity-Status: Confirmed May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Is-Admin-Project: True May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Openstack-Nova-Api-Version: 2.90 May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Project-Domain-Id: default May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Project-Domain-Name: Default May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Project-Id: 3a3ee3f323ac4b12815e2057e52b4ed6 May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Project-Name: admin May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Role: admin,member,reader May 17 17:03:46.291348 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Roles: admin,member,reader May 17 17:03:46.292915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:03:46.292915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Tenant: admin May 17 17:03:46.292915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Tenant-Id: 3a3ee3f323ac4b12815e2057e52b4ed6 May 17 17:03:46.292915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-Tenant-Name: admin May 17 17:03:46.292915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User: admin May 17 17:03:46.292915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User-Domain-Id: default May 17 17:03:46.292915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User-Domain-Name: Default May 17 17:03:46.292915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User-Id: f95fdce949f547f29f3329fa96fe74ac May 17 17:03:46.292915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: X-User-Name: admin May 17 17:03:46.292915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: method: > May 17 17:03:46.292915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: exception: Flavor 451 could not be found. May 17 17:03:46.292915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: action_args: {'id': '451'} May 17 17:03:46.292915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:03:46.292915 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:03:46.293900 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 17 17:03:46.295328 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-2d4c1179-a7ce-43c1-af8b-c7a36461d52a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:03:46.296610 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-2d4c1179-a7ce-43c1-af8b-c7a36461d52a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059133 May 17 17:03:46.296610 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 25/49] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 17 17:03:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 17:03:46.302317 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-e6820846-b0d5-4b4d-bd84-cf22e2b2f35f admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:46.316428 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-e6820846-b0d5-4b4d-bd84-cf22e2b2f35f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017589 May 17 17:03:46.316879 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 25/50] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 17 17:03:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:03:46.326500 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-8c253ece-e189-49b6-b861-9cf8209631c5 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:46.340007 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-8c253ece-e189-49b6-b861-9cf8209631c5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016941 May 17 17:03:46.340560 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 26/51] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 17 17:03:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:03:46.350123 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-516d39e8-9513-468d-a927-6de80dae218a admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:46.355439 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.wsgi [None req-516d39e8-9513-468d-a927-6de80dae218a admin admin] HTTP exception thrown: Flavor 451 could not be found. May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-516d39e8-9513-468d-a927-6de80dae218a admin admin] Request method failure captured: May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Accept: application/json May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Accept-Encoding: gzip, deflate May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Connection: keep-alive May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Content-Length: 0 May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Host: 10.222.0.48 May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Openstack-Api-Version: compute 2.90 May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Openstack-System-Scope: None May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: User-Agent: python-novaclient May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Auth-Token: gAAAAABig9VyKWv3fqUeFmvnT3tBfLL-DOJZAuz87_jkIUTNDjyb2wPtUeygZESELGvqS_LBk2HnLfMpCpI5xAULOgtA_4g_IPaWmwBVqWfjw61Dh97B2A_uKDTGjDGOJM1ye1nrO-TegrFUCp_Qqy8PX-d_2_pDavfrG5ruT3q4hlsTGcqnxbs May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Domain-Id: None May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Domain-Name: None May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Identity-Status: Confirmed May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Is-Admin-Project: True May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Openstack-Nova-Api-Version: 2.90 May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Project-Domain-Id: default May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Project-Domain-Name: Default May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Project-Id: 3a3ee3f323ac4b12815e2057e52b4ed6 May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Project-Name: admin May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Role: admin,member,reader May 17 17:03:46.356950 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Roles: admin,member,reader May 17 17:03:46.358343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a3ee3f323ac4b12815e2057e52b4ed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:03:46.358343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Tenant: admin May 17 17:03:46.358343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Tenant-Id: 3a3ee3f323ac4b12815e2057e52b4ed6 May 17 17:03:46.358343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-Tenant-Name: admin May 17 17:03:46.358343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User: admin May 17 17:03:46.358343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User-Domain-Id: default May 17 17:03:46.358343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User-Domain-Name: Default May 17 17:03:46.358343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User-Id: f95fdce949f547f29f3329fa96fe74ac May 17 17:03:46.358343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: X-User-Name: admin May 17 17:03:46.358343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: method: > May 17 17:03:46.358343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: exception: Flavor 451 could not be found. May 17 17:03:46.358343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: action_args: {'id': '451'} May 17 17:03:46.358343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:03:46.358343 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:03:46.359451 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 17 17:03:46.360831 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-516d39e8-9513-468d-a927-6de80dae218a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:03:46.362037 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-516d39e8-9513-468d-a927-6de80dae218a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011739 May 17 17:03:46.362037 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 26/52] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 17 17:03:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 17:03:47.258673 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-8c253ece-e189-49b6-b861-9cf8209631c5 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:47.259709 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-8c253ece-e189-49b6-b861-9cf8209631c5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 May 17 17:03:47.260340 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 27/53] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 17 17:03:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:03:47.473085 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-3eec776f-d139-489a-a70d-c633a480c9b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:47.493030 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-3eec776f-d139-489a-a70d-c633a480c9b2 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.080972 May 17 17:03:47.493611 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 27/54] 10.222.0.48 () {64 vars in 1235 bytes} [Tue May 17 17:03:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:03:48.385198 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-8c253ece-e189-49b6-b861-9cf8209631c5 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:48.386198 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-8c253ece-e189-49b6-b861-9cf8209631c5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 17 17:03:48.386591 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 28/55] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 17 17:03:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:48.582190 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-8e563c85-1c27-47b4-81c5-0cac9dfdae2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:48.599335 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-8e563c85-1c27-47b4-81c5-0cac9dfdae2f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067481 May 17 17:03:48.599843 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 28/56] 10.222.0.48 () {64 vars in 1235 bytes} [Tue May 17 17:03:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:03:49.481945 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-8c253ece-e189-49b6-b861-9cf8209631c5 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:49.483000 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-8c253ece-e189-49b6-b861-9cf8209631c5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001612 May 17 17:03:49.483399 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 29/57] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 17 17:03:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:49.673981 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-8661e3a9-9343-4754-af3a-932ff443ca7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:49.690919 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-8661e3a9-9343-4754-af3a-932ff443ca7f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068376 May 17 17:03:49.691526 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 29/58] 10.222.0.48 () {64 vars in 1235 bytes} [Tue May 17 17:03:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:03:50.578066 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-8c253ece-e189-49b6-b861-9cf8209631c5 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:50.579059 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-8c253ece-e189-49b6-b861-9cf8209631c5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 May 17 17:03:50.579448 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 30/59] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 17 17:03:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:50.764652 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-45196867-9688-4a10-9232-6c11e3eaad39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:03:50.782452 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-45196867-9688-4a10-9232-6c11e3eaad39 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067419 May 17 17:03:50.782996 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 30/60] 10.222.0.48 () {64 vars in 1235 bytes} [Tue May 17 17:03:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:03:51.707576 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-8c253ece-e189-49b6-b861-9cf8209631c5 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:51.708679 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-8c253ece-e189-49b6-b861-9cf8209631c5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 May 17 17:03:51.709081 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 31/61] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 17 17:03:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:03:51.967582 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-0c1c6035-29ca-4e63-8ca1-99f7e6b3cc1b admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:03:51.987967 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-0c1c6035-29ca-4e63-8ca1-99f7e6b3cc1b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076109 May 17 17:03:51.988530 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 31/62] 10.222.0.48 () {60 vars in 1202 bytes} [Tue May 17 17:03:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:04:56.426662 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-8c253ece-e189-49b6-b861-9cf8209631c5 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:04:56.427700 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-8c253ece-e189-49b6-b861-9cf8209631c5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 17 17:04:56.428107 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 32/63] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 17 17:04:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:04:56.485958 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-9ad37b9e-370b-4ada-af32-fa5530152027 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:04:56.505460 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-9ad37b9e-370b-4ada-af32-fa5530152027 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071196 May 17 17:04:56.505997 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 32/64] 10.222.0.48 () {60 vars in 1291 bytes} [Tue May 17 17:04:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:04:56.528318 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-0b7b0f0f-f0b1-4b3b-8c46-9bb713bde220 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:04:56.535937 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-0b7b0f0f-f0b1-4b3b-8c46-9bb713bde220 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011767 May 17 17:04:56.536445 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 33/65] 10.222.0.48 () {60 vars in 1282 bytes} [Tue May 17 17:04:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:04:56.547295 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-f6748c4f-b88b-4df1-bf82-f2c9e7982bae admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:04:56.555121 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-f6748c4f-b88b-4df1-bf82-f2c9e7982bae admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011311 May 17 17:04:56.555654 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 33/66] 10.222.0.48 () {60 vars in 1285 bytes} [Tue May 17 17:04:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:04:56.567435 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-f9c8f7da-61cc-4db9-9558-6e24743b598d admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:04:56.574864 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-f9c8f7da-61cc-4db9-9558-6e24743b598d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012100 May 17 17:04:56.575379 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 34/67] 10.222.0.48 () {60 vars in 1285 bytes} [Tue May 17 17:04:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:04:56.586708 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-de03600c-84d8-4875-a2ba-e84735a7135d admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:04:56.594007 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-de03600c-84d8-4875-a2ba-e84735a7135d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010705 May 17 17:04:56.594509 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 34/68] 10.222.0.48 () {60 vars in 1282 bytes} [Tue May 17 17:04:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:08:15.276303 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-f9c8f7da-61cc-4db9-9558-6e24743b598d admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:08:15.278291 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-f9c8f7da-61cc-4db9-9558-6e24743b598d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 May 17 17:08:15.278727 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 35/69] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 17 17:08:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:08:15.543530 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-7db845d5-c3a0-468a-89a0-3f16774ecd3a admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:08:15.545048 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:08:15.545048 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: warnings.warn(msg) May 17 17:08:15.546242 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-7db845d5-c3a0-468a-89a0-3f16774ecd3a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:08:15.546675 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-7db845d5-c3a0-468a-89a0-3f16774ecd3a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:08:15.547449 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-7db845d5-c3a0-468a-89a0-3f16774ecd3a admin admin] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:08:15.547902 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-7db845d5-c3a0-468a-89a0-3f16774ecd3a admin admin] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:08:15.580645 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-7db845d5-c3a0-468a-89a0-3f16774ecd3a admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148396 May 17 17:08:15.581194 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 35/70] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 17 17:08:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:08:16.484287 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-f9c8f7da-61cc-4db9-9558-6e24743b598d admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:08:16.485308 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-f9c8f7da-61cc-4db9-9558-6e24743b598d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 17 17:08:16.485703 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 36/71] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 17 17:08:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:08:16.675592 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-60cddc64-fe52-4dfa-aca7-35187b5e91c9 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:08:16.676797 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:08:16.676797 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: warnings.warn(msg) May 17 17:08:16.678007 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-60cddc64-fe52-4dfa-aca7-35187b5e91c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:08:16.678449 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-60cddc64-fe52-4dfa-aca7-35187b5e91c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:08:16.679249 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-60cddc64-fe52-4dfa-aca7-35187b5e91c9 admin admin] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:08:16.679712 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-60cddc64-fe52-4dfa-aca7-35187b5e91c9 admin admin] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:08:16.699825 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-60cddc64-fe52-4dfa-aca7-35187b5e91c9 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074025 May 17 17:08:16.700311 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 36/72] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 17 17:08:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:08:28.012573 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-f9c8f7da-61cc-4db9-9558-6e24743b598d admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:08:28.013617 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-f9c8f7da-61cc-4db9-9558-6e24743b598d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002066 May 17 17:08:28.014011 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 37/73] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 17 17:08:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:08:28.200167 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-9b5f9fd8-4039-4156-9ad9-ae9361be1c13 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:08:28.201322 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:08:28.201322 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: warnings.warn(msg) May 17 17:08:28.202520 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-9b5f9fd8-4039-4156-9ad9-ae9361be1c13 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:08:28.202960 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-9b5f9fd8-4039-4156-9ad9-ae9361be1c13 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:08:28.203769 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-9b5f9fd8-4039-4156-9ad9-ae9361be1c13 admin admin] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:08:28.204200 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-9b5f9fd8-4039-4156-9ad9-ae9361be1c13 admin admin] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:08:28.228816 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-9b5f9fd8-4039-4156-9ad9-ae9361be1c13 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079832 May 17 17:08:28.229302 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 37/74] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 17 17:08:28 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:08:29.130690 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-f9c8f7da-61cc-4db9-9558-6e24743b598d admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:08:29.131727 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-f9c8f7da-61cc-4db9-9558-6e24743b598d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 17 17:08:29.132127 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 38/75] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 17 17:08:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:08:29.321716 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-84bf38b0-9c6a-4536-9cab-3cd55bd361af admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:08:29.322901 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:08:29.322901 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: warnings.warn(msg) May 17 17:08:29.324131 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-84bf38b0-9c6a-4536-9cab-3cd55bd361af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:08:29.324569 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-84bf38b0-9c6a-4536-9cab-3cd55bd361af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:08:29.325515 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-84bf38b0-9c6a-4536-9cab-3cd55bd361af admin admin] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:08:29.325944 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-84bf38b0-9c6a-4536-9cab-3cd55bd361af admin admin] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:08:29.348378 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-84bf38b0-9c6a-4536-9cab-3cd55bd361af admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078799 May 17 17:08:29.348858 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 38/76] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 17 17:08:29 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:09:28.754902 dv-cinder-842149-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 17 17:09:28.755920 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: Tue May 17 17:09:28 2022 - graceful shutdown triggered... May 17 17:09:28.756435 dv-cinder-842149-1-iscsi devstack@n-api.service[102736]: Gracefully killing worker 1 (pid: 102736)... May 17 17:09:28.756799 dv-cinder-842149-1-iscsi devstack@n-api.service[102737]: Gracefully killing worker 2 (pid: 102737)... May 17 17:09:29.757062 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: worker 1 buried after 1 seconds May 17 17:09:29.757062 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: worker 2 buried after 1 seconds May 17 17:09:29.757062 dv-cinder-842149-1-iscsi devstack@n-api.service[102735]: goodbye to uWSGI. May 17 17:09:29.758727 dv-cinder-842149-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 17 17:09:29.759315 dv-cinder-842149-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 17 17:09:29.762075 dv-cinder-842149-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 17 17:09:29.780391 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 17 17:09:29.806698 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 17:09:29 2022] *** May 17 17:09:29.806698 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 17:09:29.806698 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 17:09:29.806698 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: nodename: dv-cinder-842149-1-iscsi May 17 17:09:29.806698 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: machine: x86_64 May 17 17:09:29.806698 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: clock source: unix May 17 17:09:29.806698 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: pcre jit disabled May 17 17:09:29.806698 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: detected number of CPU cores: 4 May 17 17:09:29.806698 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: current working directory: / May 17 17:09:29.806698 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: detected binary path: /usr/bin/uwsgi-core May 17 17:09:29.806698 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: your processes number limit is 47680 May 17 17:09:29.806698 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: your memory page size is 4096 bytes May 17 17:09:29.806698 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: detected max file descriptor number: 2048 May 17 17:09:29.807787 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: lock engine: pthread robust mutexes May 17 17:09:29.807787 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: thunder lock: enabled May 17 17:09:29.807787 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 17 17:09:29.807787 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 17:09:29.854721 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: Python main interpreter initialized at 0x556953a3e9c0 May 17 17:09:29.854721 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: python threads support enabled May 17 17:09:29.854721 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: your server socket listen backlog is limited to 100 connections May 17 17:09:29.854721 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: your mercy for graceful operations on workers is 90 seconds May 17 17:09:29.855173 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: mapped 403077 bytes (393 KB) for 2 cores May 17 17:09:29.855173 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: *** Operational MODE: preforking *** May 17 17:09:29.855452 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: *** uWSGI is running in multiple interpreter mode *** May 17 17:09:29.855452 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: spawned uWSGI master process (pid: 117073) May 17 17:09:29.855686 dv-cinder-842149-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 17 17:09:29.856835 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: spawned uWSGI worker 1 (pid: 117089, cores: 1) May 17 17:09:29.856835 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: spawned uWSGI worker 2 (pid: 117090, cores: 1) May 17 17:09:29.856835 dv-cinder-842149-1-iscsi devstack@n-api.service[117073]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 17:09:31.103258 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 17:09:31.116272 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 17:09:31.958969 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:09:31.958969 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: from cryptography.utils import int_from_bytes May 17 17:09:31.959336 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:09:31.959336 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: from cryptography.utils import int_from_bytes May 17 17:09:31.971383 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:09:31.971383 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: from cryptography.utils import int_from_bytes May 17 17:09:31.971883 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:09:31.971883 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: from cryptography.utils import int_from_bytes May 17 17:09:34.555770 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 17:09:34.556408 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 17:09:34.556682 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 17:09:34.556934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 17:09:34.557202 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 17:09:34.557590 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.557922 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.558251 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.558576 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.558915 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.559235 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.559563 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.560691 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.560863 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.561110 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.561432 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.561767 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842149-1-iscsi {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.562098 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.562415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.562737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.563064 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.563379 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.563735 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.564053 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.564561 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.566134 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.566508 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.566835 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.567195 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.567527 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.567881 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.568220 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.568540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.568882 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.569204 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.569626 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842149-1-iscsi {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.569957 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.570284 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.570617 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.571054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.571374 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.571715 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.572047 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.572383 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.572701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.573039 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.573366 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.573695 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.574022 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.574330 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.574650 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.574984 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.575292 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.575689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.575689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.575689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.575689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.575689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.575689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.575689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.579957 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.579957 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.579957 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.579957 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.579957 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.579957 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.580796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.580796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.581085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.581238 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.581406 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.581724 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.582051 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.582374 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.582704 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.583013 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.583338 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.583793 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.584056 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.584376 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.584727 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.585054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.585374 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.585699 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.586027 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.586342 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.586657 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.586972 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.587301 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.587649 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.587964 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.588223 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.588535 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.588846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.589170 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.589481 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.589792 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.590101 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.590408 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.590804 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.591035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.591386 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.591893 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.592218 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.592523 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.592841 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.593150 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.593463 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.593790 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.594117 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.594429 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.594753 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.595052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.595364 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.595712 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.596025 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.596336 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.596664 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.596977 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.597290 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.597613 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.597927 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.598239 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.598566 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.598873 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.599187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.599514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.599853 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.600167 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.600480 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.600797 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.601110 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.601423 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.601735 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.602086 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.602438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.603004 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.603004 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.603312 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.603596 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.603930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.604257 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.604607 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.604948 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.605766 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.605766 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.606074 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.606278 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.606606 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.607468 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.607815 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.608155 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.608478 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.608804 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.609120 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.609448 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.609775 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.610114 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.610444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.610769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.611102 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.611423 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.611772 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.612150 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.612570 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.612752 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.613179 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.613447 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.613772 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.614107 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.614442 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.614763 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.615085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.615423 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.615790 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.616080 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.616400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.616728 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.617046 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.617366 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.617686 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.618008 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.618324 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.618669 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.618992 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.619312 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.619649 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.619978 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.620297 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.620616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.620934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.621249 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.621561 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.621874 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.622198 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.623059 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.623630 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 17:09:34.624158 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.624323 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 17:09:34.624480 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.624480 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.624796 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 17:09:34.624952 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.625105 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 17:09:34.625250 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.625503 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 17:09:34.625664 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.625946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.626191 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.626343 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.626531 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.626688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.626841 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.627000 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.627161 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.627315 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.627468 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.627650 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.627829 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.628544 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.628644 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.628729 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.628804 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.628885 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.628885 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.629035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.629107 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.629192 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.629274 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842149-1-iscsi {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.629347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.629427 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.629507 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.629579 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.629661 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.629733 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.629811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.629897 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.629977 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.630328 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.630506 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.630668 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.630825 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.631008 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.631163 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.631163 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.631458 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.631679 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.631859 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.632022 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.632171 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.632443 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.632689 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.632847 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.633002 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.633163 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.633329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.633854 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.634008 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.634171 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.634333 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.634501 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.634658 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.634813 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.634981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.635137 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.635282 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.635427 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.635699 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842149-1-iscsi {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.635853 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.636039 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.636362 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.636362 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.636688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.636846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.636999 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.637167 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.637315 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.637470 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.637615 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.637785 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.637943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.638120 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.638277 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.638446 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.638594 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.638756 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.638932 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.639081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.639224 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.639367 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.639536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.639725 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.639880 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.640057 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.640204 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.640356 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.640528 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.640687 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.640856 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.641002 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.641163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.641318 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.641471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.641644 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.641792 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.641935 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.642120 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.642479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.642673 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.642903 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.643063 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.643226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.643371 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.643524 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.644040 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.644203 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.644374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.644534 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.644679 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.644679 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.644965 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.645138 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.645314 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.645467 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.645620 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.645879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.646029 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.646475 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.646640 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.646810 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.646968 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.647112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.647255 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.647432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.647580 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.647896 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.648047 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.648199 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.648344 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.648580 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.648727 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.648870 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.649033 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.649185 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.649337 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.649492 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.649662 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.649807 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.649970 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.650123 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.650298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.650298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.650576 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.650576 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.650850 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.651026 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.651187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.651187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.651494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.651663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.651834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.651988 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.652165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.652311 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.652482 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.652724 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.652902 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.653144 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.653310 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.653455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.653601 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.653601 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.654292 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.654656 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.654817 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.654963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.655118 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.655118 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.655404 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.655404 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.655732 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.655915 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.656136 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.656297 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.656614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.656877 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.657053 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.657199 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.657351 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.657531 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.657689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.657851 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.657997 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.658150 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.658414 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.658573 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.658741 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.658902 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.659048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.659204 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.659373 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.659528 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.659726 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.659874 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.660045 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.660205 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.660352 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.660520 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.660684 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.660840 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.660986 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.661157 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.661324 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.661469 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.661641 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.661793 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.661938 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.662090 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.662259 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.662405 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.662558 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.662745 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.662965 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.663148 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.663398 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.663562 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.663742 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.663888 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.664300 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.664566 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.664744 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.664904 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.665050 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.665213 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.665368 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.665521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.665667 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.665846 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.665993 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.666156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.666398 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.666951 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.667122 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.667278 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.667433 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.667662 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.667829 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.667983 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.668144 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.668300 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.668468 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.668644 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.668810 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.668955 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.669108 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.669995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.670295 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.670457 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.670604 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.670748 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.670907 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.671055 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.671209 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.671379 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.671552 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.671721 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.671866 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.672010 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.672171 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.672333 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.672480 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.672654 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.672805 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.672988 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.673214 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.673407 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.673648 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.673799 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.673952 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.674103 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:09:34.674550 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.674812 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.674964 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.675110 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.675281 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.675427 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.675582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.675823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.675991 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.676144 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.676309 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.676548 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.676548 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.676871 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.677161 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.677325 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.677479 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.677633 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.677797 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.677960 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.678118 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.678298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.678458 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.678603 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.678756 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.678917 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.679062 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.679216 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.679375 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.679531 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.679531 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.679838 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.680077 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.680235 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.680404 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.680559 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.680713 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.680858 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.681031 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.681177 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.681933 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.682114 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.682262 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.682415 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.682594 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.682741 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.682897 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.683058 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.683559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.683805 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.683968 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.684133 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.684448 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.684765 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.685661 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.685826 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.685973 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.686158 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.686319 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.686319 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.686715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.686715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.687007 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.687347 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.687513 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.687688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.687863 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.688018 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.688163 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.688330 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.688511 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.688661 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.688814 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.688969 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.689130 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.689299 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.689453 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.689605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.689751 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.689911 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.690057 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.690225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.690384 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.690545 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.690703 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.690855 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.691001 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.691001 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.691358 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.691505 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.691681 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.691934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.692106 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.692261 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.692414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.692571 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.692739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.692897 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.693052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.693206 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.693350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.693535 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.693789 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.694024 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.694203 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.694203 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.694675 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.694675 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.695125 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.695274 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.695274 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.695823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.695997 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.696155 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.696302 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.696461 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.696614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.696870 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.697458 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.697617 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.697778 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.697891 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.697988 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.698082 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.698166 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.698254 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.698338 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.698432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.698528 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.698614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.698697 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.698780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.698863 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.698959 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.699044 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.699135 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.699220 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.699312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.699410 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.699505 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.699596 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.699697 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.699781 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.699878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.699978 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.700119 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.700221 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.700306 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.700389 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.700480 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.700601 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.700688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.700780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.700865 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.700948 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.701079 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.701172 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.701256 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.701389 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.701481 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.701565 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.701663 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.701755 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.701848 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.701933 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.702023 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.702115 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.702207 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.702292 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.702292 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.702451 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.702529 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.702621 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.702720 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.702822 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.702915 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.703000 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.703091 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.703175 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.703267 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.703360 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.703444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.703527 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.703864 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.704004 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.704107 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.704195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.704286 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.704370 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.704370 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.704530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.704654 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.704741 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.704825 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.704915 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.705026 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.705121 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.705207 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.705290 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.705381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.705471 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.705471 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.705632 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.705724 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.705808 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.705904 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.705904 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.706066 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.706163 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.706256 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.706348 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.706432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.706521 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.706693 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.706788 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.707035 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.707127 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.707219 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.707312 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.707422 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.707676 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.707767 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.707859 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.707950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.708058 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.708158 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.708255 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.708341 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.708432 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.708516 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.708608 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.708693 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.708784 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.708876 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.708960 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.709043 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.709135 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.709231 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.709323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.709323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.709477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.709560 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.709652 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.709737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.709820 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.709903 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.709994 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.710080 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.710176 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.710268 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.710372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.710458 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.710542 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.710634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.710726 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.710812 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.710896 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.710986 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.711085 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.711189 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.711282 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.711367 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.711450 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.711541 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.712284 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.712408 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.712504 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.712597 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.712691 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.712785 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.712879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.712974 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.713067 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.713153 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.713237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.713321 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.713417 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.713504 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.713588 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.713679 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.713763 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.713855 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.713967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.714048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.714133 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.714225 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.714310 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.714471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.714589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.714743 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.714830 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.715062 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.715156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.715382 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.715479 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.715717 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.715815 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.716031 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.716153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.716487 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.716601 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.716890 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.717142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.717234 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.717328 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.717429 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.717515 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.717753 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.717848 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.718055 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.718150 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.718369 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.718483 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.718700 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.718789 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.719065 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.719148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.719380 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.719466 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.719735 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.719832 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.720060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.720179 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.720378 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.720503 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.720694 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.720824 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.721016 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.721163 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.721349 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.721495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.721669 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.721826 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.722000 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.722141 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.722331 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.722464 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.722645 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.722783 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.722989 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.723115 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.723493 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.723787 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.724095 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.724201 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.724422 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.724751 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.724857 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.725083 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.725216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.725403 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.725592 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.725732 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.725930 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.726158 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.726320 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.726491 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.726663 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.726812 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.726993 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.727144 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.727335 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.727483 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.727851 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.728108 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.728255 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.728444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.728541 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.728758 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.728907 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.729073 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.729221 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.729404 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.729542 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.729720 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.729866 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.730040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.730188 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.730357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.730502 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.730675 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.730820 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.730991 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.731128 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.731304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.731440 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.731652 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.732310 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.732490 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.732825 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.732967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.733236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.733400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.733545 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.733679 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.733878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.734020 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.734197 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.734337 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.734520 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.734649 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.734837 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.734995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.735139 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.735450 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.735592 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.735782 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.735925 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.736127 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.736284 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.736444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.736582 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.736775 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.736918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.737128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.737254 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.737436 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.737591 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.737758 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.737904 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.738099 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.738251 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.738432 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.738585 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.738757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.738916 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.739079 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.739225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.739411 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.739548 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.739726 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.739885 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.740031 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.740165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.740350 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.740511 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.740649 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.740792 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.740966 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.741112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.741268 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.741412 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.741581 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.741735 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.741879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.742012 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.742186 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.742352 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.742488 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.742629 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.742812 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.742952 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.743119 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.743333 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.743481 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.743674 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.743811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.743934 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.744094 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.744230 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.744373 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.744510 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.744670 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.744813 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.745007 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.745147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.745321 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.745459 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.745660 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.745818 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.745989 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.746128 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.746320 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.746507 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.746690 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.746849 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.747009 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.747155 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.747341 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.747534 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.747727 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.747913 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.748206 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.748381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.748541 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.748698 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.748855 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.749033 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.749184 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.749332 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.749510 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.749683 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.749842 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.750001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.750176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.750325 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.750473 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.750644 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.750808 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.750974 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.751124 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.751286 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.751286 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.751580 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.751793 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.751950 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.752099 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.752248 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.752412 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.752571 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.752729 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.752877 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.753048 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.753202 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.753357 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.753514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.753700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.753850 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.753998 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.754180 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.754334 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.754495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.754656 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.754829 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.754987 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.755142 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.755290 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.755466 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.755660 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.755660 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.755982 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.755982 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.756274 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.756274 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.756587 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.756770 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.757039 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.757223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.757409 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.757409 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.757732 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.757732 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.758029 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.758190 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.758365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.758516 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.758672 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.758822 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.759024 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.759263 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.759432 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.759595 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.759788 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.759974 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.760143 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.760292 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.760464 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.760631 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.760783 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.760931 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.761106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.761255 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.761411 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.761578 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.761736 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.761885 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.762059 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.762225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.762374 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.762531 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.762698 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.762857 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.763548 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.763742 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.764038 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.764190 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.764338 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.764500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.764669 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.764820 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.764968 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.765122 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.765280 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.765452 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.765452 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.765744 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.765894 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.766049 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.766277 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.766427 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.766574 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.766740 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.766888 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.767036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.767197 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.767456 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.767639 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.767807 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.767965 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.768113 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.768270 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.768427 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.768575 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.768721 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.768878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.769035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.769196 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.769344 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.769499 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.769647 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.769801 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.769959 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.770115 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.770273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.770421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.770568 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.770722 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.770902 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.771061 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.771218 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.771377 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.771533 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.771705 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.771868 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.772018 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.772175 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.772331 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.772488 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.772644 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.772812 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.772961 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.773116 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.773273 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.773431 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.773588 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.773736 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.773891 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.774047 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.774203 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.774358 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.774525 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.774674 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.774840 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.774996 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.775143 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.775291 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.775448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.775628 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.775796 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.775946 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.776101 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.776261 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.776425 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.776582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.776730 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.776897 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.777046 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.777208 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.777357 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.777609 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.777772 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.777922 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.778069 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.778227 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.778385 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.778535 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.778745 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.779401 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.779560 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.779795 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.779946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.780101 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.780252 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.780409 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.780559 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.780716 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.780864 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.781020 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.781168 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.781315 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.781482 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.781633 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.781780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.781928 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.782086 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.782242 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.782412 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.782563 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.782719 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.782876 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.783024 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.783171 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.783328 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.783495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.783495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.783821 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.783972 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.784119 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.784277 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.784425 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.784581 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.784737 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.784886 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.785033 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.785189 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.785339 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.785496 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.785652 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.785801 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.785963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.785963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.786259 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.786407 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.786563 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.786711 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.786869 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.787018 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.787176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.787334 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.787482 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.787665 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.787834 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.787992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.788141 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.788289 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.788437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.788593 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.788749 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.788749 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.789040 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.789197 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.789355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.789513 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.789669 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.789826 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.789989 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.790142 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.790291 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.790447 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.790596 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.790755 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.790911 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.791068 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.791224 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.791391 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.791549 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.792013 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.792169 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.792324 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.792496 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.792660 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.792823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.792986 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.793143 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.793299 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.793469 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.793648 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.793803 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.793966 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.794122 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.794790 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.794963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.795135 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.795328 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.795520 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.795520 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.795867 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.795867 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.796181 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.796349 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.796504 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.796504 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.796890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.797057 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.797057 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.797364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.797518 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.797680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.797680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.797999 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.798162 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.798329 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.798436 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.798537 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.798662 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.798741 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.798828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.798914 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.798998 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.799096 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.799256 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.799425 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.799582 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.799822 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.799990 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.800155 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.800327 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.800488 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.800651 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.800806 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.800960 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.801136 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.801291 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.801455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.801618 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.801774 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.801953 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.802110 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.802272 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.802429 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.802584 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.802738 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.802902 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.803057 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.803213 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.803375 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.803531 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.803732 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.803904 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.804072 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.804227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.804389 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.804544 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.804700 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.804700 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.805014 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.805169 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.805322 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.805477 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.805645 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.805847 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.806047 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.806227 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.806392 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.806548 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.806714 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.806897 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.807051 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.807186 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.807324 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.807467 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.807711 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.807852 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.807852 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.808128 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.808272 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.808416 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.808548 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.808703 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.808844 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.808976 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.809108 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.809256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.809397 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.809530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.809662 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.809795 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.810033 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.810737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.810933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.811082 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.811217 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.811358 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.811493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.811657 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.811794 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.811969 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.812109 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.812290 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.812427 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.812604 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.812741 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.812935 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.813079 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.813266 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.813422 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.813567 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.813700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.813889 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.814027 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.814210 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.814358 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.814529 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.814673 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.814852 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.814990 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.815170 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.815319 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.815490 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.815663 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.815835 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.816174 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.816486 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.816635 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.816812 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.816956 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.817145 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.817291 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.817468 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.817606 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.817801 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.817948 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.818127 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.818275 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.818448 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.818587 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.818773 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.818911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.819092 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.819236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.819411 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.819551 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.819761 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.819910 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.820081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.820229 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.820401 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.820549 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.820727 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.820864 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.821056 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.821208 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.821388 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.821633 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.821781 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.822007 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.822145 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.822334 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.822474 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.822659 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.822803 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.822983 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.823129 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.823307 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.823446 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.823649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.823790 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.823975 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.824133 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.824305 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.824444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.824620 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.824756 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.824932 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.825081 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.825216 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 17:09:34.825350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.825617 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.825969 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.826303 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.826627 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.826953 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.827277 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.827615 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.827987 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.828312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.828632 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.828955 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.829280 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.829607 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.829927 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.830245 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.830568 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.830891 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.831211 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.831530 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.831876 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.832198 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.832529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.832872 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.833200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.833522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.833845 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.834176 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.834711 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.835034 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.835375 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.835733 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.836069 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.836395 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.836721 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.837058 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.837376 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.837690 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.838007 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.838325 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.838639 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.838972 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.839291 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.839651 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.839984 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.840304 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.840846 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.841255 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.841579 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.841914 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.842247 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.842573 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.842889 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.843221 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.844204 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.844204 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.844204 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.844565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.844807 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.845163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.845470 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.845792 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.846103 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.846489 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.846798 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.847142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.847458 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.847813 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.848115 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.848431 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.848760 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.848926 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_db.sqlalchemy.engines [None req-f639a6b9-0968-4cf1-83d1-3159819c9f08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:09:34.849086 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.849364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.849677 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.850001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.850312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.850630 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.850943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.851263 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.851688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.851925 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.852285 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.852621 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.852935 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.853248 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.853604 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.853932 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.854262 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.854583 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.854901 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.855258 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.855585 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.856185 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.856526 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.857377 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.857720 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.858064 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.858381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.858696 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.859012 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.860042 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.860318 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.860644 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.860966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.861318 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.861639 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.861961 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.862280 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.862600 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.862918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.863238 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.863557 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.863902 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.864226 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.864578 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.864910 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.865237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.865564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.865890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.866212 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.866532 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.866849 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.867166 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.867516 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.867877 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.868199 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.868514 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.868953 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.869275 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.869604 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.869936 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.870252 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.870586 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.870916 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.871235 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.871565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.871984 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.872249 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.872817 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.873161 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.873499 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.873814 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.874131 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.874452 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.874773 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.875102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.875423 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.875838 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.876153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.876471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.876783 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.877097 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.877408 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.877723 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.878036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.878345 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.878658 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.878969 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.879278 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.879590 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.879934 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.880252 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.880563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.880878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.881192 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.881505 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.881816 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.882158 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.882496 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.882820 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.883151 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.883473 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.883828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.884153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.884484 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.884813 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.885137 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.885457 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.885799 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.886120 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.886440 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.886762 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.887082 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.887405 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.887750 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.888652 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.888990 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.889309 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.889645 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.889973 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.890307 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.890634 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.890956 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.891298 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.891639 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.891966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.892296 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.892614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.892935 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.893263 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.893590 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.893925 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.894266 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.894588 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.894923 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.895259 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.895633 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.895961 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.896390 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.896653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.896978 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.897300 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.897613 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:09:34.897865 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 17:09:34.914638 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.context [None req-f639a6b9-0968-4cf1-83d1-3159819c9f08 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5cb3f3d-542a-485b-8bb4-94fae1d56923(cell1) {{(pid=117090) load_cells /opt/stack/nova/nova/context.py:464}} May 17 17:09:34.919317 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f639a6b9-0968-4cf1-83d1-3159819c9f08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:09:34.921274 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f639a6b9-0968-4cf1-83d1-3159819c9f08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:09:34.922085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f639a6b9-0968-4cf1-83d1-3159819c9f08 None None] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:09:34.924233 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f639a6b9-0968-4cf1-83d1-3159819c9f08 None None] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:09:34.928747 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_db.sqlalchemy.engines [None req-121ff2d3-33d9-4fbd-8988-65aeed8422ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117089) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:09:34.937685 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_db.sqlalchemy.engines [None req-f639a6b9-0968-4cf1-83d1-3159819c9f08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:09:34.939789 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_db.sqlalchemy.engines [None req-f639a6b9-0968-4cf1-83d1-3159819c9f08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:09:35.002767 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.context [None req-121ff2d3-33d9-4fbd-8988-65aeed8422ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5cb3f3d-542a-485b-8bb4-94fae1d56923(cell1) {{(pid=117089) load_cells /opt/stack/nova/nova/context.py:464}} May 17 17:09:35.007235 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-121ff2d3-33d9-4fbd-8988-65aeed8422ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:09:35.009026 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-121ff2d3-33d9-4fbd-8988-65aeed8422ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:09:35.010314 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-121ff2d3-33d9-4fbd-8988-65aeed8422ae None None] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:09:35.012865 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-121ff2d3-33d9-4fbd-8988-65aeed8422ae None None] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:09:35.026788 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_db.sqlalchemy.engines [None req-121ff2d3-33d9-4fbd-8988-65aeed8422ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117089) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:09:35.028339 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_db.sqlalchemy.engines [None req-121ff2d3-33d9-4fbd-8988-65aeed8422ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117089) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:09:35.108252 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_db.sqlalchemy.engines [None req-f639a6b9-0968-4cf1-83d1-3159819c9f08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:09:35.201916 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_db.sqlalchemy.engines [None req-121ff2d3-33d9-4fbd-8988-65aeed8422ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117089) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:09:35.468068 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: WARNING keystonemiddleware.auth_token [None req-f639a6b9-0968-4cf1-83d1-3159819c9f08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:09:35.475988 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: WARNING keystonemiddleware.auth_token [None req-f639a6b9-0968-4cf1-83d1-3159819c9f08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:09:35.545417 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: WARNING keystonemiddleware.auth_token [None req-121ff2d3-33d9-4fbd-8988-65aeed8422ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:09:35.553800 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: WARNING keystonemiddleware.auth_token [None req-121ff2d3-33d9-4fbd-8988-65aeed8422ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:09:35.871416 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: WARNING keystonemiddleware.auth_token [None req-f639a6b9-0968-4cf1-83d1-3159819c9f08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:09:35.878830 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: WARNING keystonemiddleware.auth_token [None req-f639a6b9-0968-4cf1-83d1-3159819c9f08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:09:35.884009 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556953a3e9c0 pid: 117090 (default app) May 17 17:09:35.912339 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: WARNING keystonemiddleware.auth_token [None req-121ff2d3-33d9-4fbd-8988-65aeed8422ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:09:35.919217 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: WARNING keystonemiddleware.auth_token [None req-121ff2d3-33d9-4fbd-8988-65aeed8422ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:09:35.925339 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556953a3e9c0 pid: 117089 (default app) May 17 17:10:20.102918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ebb81eb7-47a8-4904-bd3a-cfe58c9e6112 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Action: 'create', calling method: .version_select at 0x7feb19890280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-697623353"}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:22.000984 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-783731676", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "networks": [{"uuid": "7ea9debc-8f24-47f4-b948-da6947775f55"}]}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:22.509676 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] validate_networks() for [('7ea9debc-8f24-47f4-b948-da6947775f55', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:10:22.644298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ebb81eb7-47a8-4904-bd3a-cfe58c9e6112 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.912609 May 17 17:10:22.648791 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1154 bytes} [Tue May 17 17:10:18 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3920 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 17 17:10:22.661310 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-86be96bc-8eec-4969-bb8e-dadcf7a6f9e1 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb196e4280>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:22.777507 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-86be96bc-8eec-4969-bb8e-dadcf7a6f9e1 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358" status: 200 len: 344 microversion: 2.1 time: 0.120727 May 17 17:10:22.782937 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 2/2] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:10:22 2022] GET /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358 => generated 344 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:23.792074 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-28b54ee9-8fd2-4e5c-ae0e-64f55e468a90 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb196e44c0>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:23.927545 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-28b54ee9-8fd2-4e5c-ae0e-64f55e468a90 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358" status: 200 len: 345 microversion: 2.1 time: 0.141063 May 17 17:10:23.928133 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 3/3] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:10:23 2022] GET /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358 => generated 345 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:10:23.942744 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-17a57e39-ef49-432e-80b8-9057765ebab4 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Action: 'create', calling method: .version_select at 0x7feb196e4940>, body: {"snapshot": {"volume_id": "8971ca52-80d2-4462-b769-e257c726c358", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1793011261"}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:24.508750 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-17a57e39-ef49-432e-80b8-9057765ebab4 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.572664 May 17 17:10:24.509331 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 4/4] 10.222.0.48 () {60 vars in 1161 bytes} [Tue May 17 17:10:23 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:10:24.521745 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-273d87cd-eb75-47f3-a6e4-5164adc3f44e tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb196ee5e0>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:24.641537 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-273d87cd-eb75-47f3-a6e4-5164adc3f44e tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6" status: 200 len: 287 microversion: 2.1 time: 0.125865 May 17 17:10:24.643380 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 5/5] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 17 17:10:24 2022] GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 => generated 287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:24.653969 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a4d75830-fea4-456c-88ed-95a82bf1bf8f tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb196e4e50>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:24.755817 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a4d75830-fea4-456c-88ed-95a82bf1bf8f tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.106552 May 17 17:10:24.757172 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 6/6] 10.222.0.48 () {58 vars in 1139 bytes} [Tue May 17 17:10:24 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:24.767968 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f7540c88-8570-4fdf-babc-e669d452f048 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb196ee280>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:24.859224 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f7540c88-8570-4fdf-babc-e669d452f048 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6" status: 200 len: 287 microversion: 2.1 time: 0.095687 May 17 17:10:24.860156 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 7/7] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 17 17:10:24 2022] GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:25.633268 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:10:25.633268 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:10:25.633268 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:10:25.633268 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:10:25.633268 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:10:25.641193 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:25.641193 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:25.641193 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:25.641193 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:25.699292 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Getting quotas for project b4111fd040fc4a4d823b5e38204286f7. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:10:25.718577 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Getting quotas for user 58e161159bbc4339b6ac52213cc7b7d1 and project b4111fd040fc4a4d823b5e38204286f7. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:10:25.753849 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:10:25.758827 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:10:25.879463 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c691c437-ddc3-4557-b78a-31a4f49922c2 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb196ee1f0>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:25.956868 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c691c437-ddc3-4557-b78a-31a4f49922c2 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6" status: 200 len: 287 microversion: 2.1 time: 0.088177 May 17 17:10:25.959549 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 8/8] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 17 17:10:25 2022] GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:25.982744 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-46b3ac41-9f2b-4706-905b-dfd7f9c21263 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.547502 May 17 17:10:25.998301 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 1/9] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:10:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:10:26.004694 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e0b63288-60f0-4692-813b-61b722dc0f22 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:26.005448 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-e0b63288-60f0-4692-813b-61b722dc0f22 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:26.268923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-e0b63288-60f0-4692-813b-61b722dc0f22 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:26.315772 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e0b63288-60f0-4692-813b-61b722dc0f22 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1214 microversion: 2.1 time: 0.312666 May 17 17:10:26.317324 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 9/10] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:25 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1214 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:26.971506 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8a8324fc-5f8e-44ad-b90c-da7f0e6e9591 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb19695280>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:27.094874 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8a8324fc-5f8e-44ad-b90c-da7f0e6e9591 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6" status: 200 len: 287 microversion: 2.1 time: 0.127995 May 17 17:10:27.095959 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 2/11] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 17 17:10:26 2022] GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 => generated 287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:27.351796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-582d7ad3-7fe1-4183-b4cf-e013cd0dedca tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:27.354388 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-582d7ad3-7fe1-4183-b4cf-e013cd0dedca tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:27.620395 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-582d7ad3-7fe1-4183-b4cf-e013cd0dedca tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:27.629849 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-582d7ad3-7fe1-4183-b4cf-e013cd0dedca tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1214 microversion: 2.1 time: 0.299011 May 17 17:10:27.630431 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 10/12] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:27 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:28.108200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f4a2c0c2-5232-4ec1-ac35-84cf38aae358 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb185f7c10>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:28.188528 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f4a2c0c2-5232-4ec1-ac35-84cf38aae358 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6" status: 200 len: 287 microversion: 2.1 time: 0.085427 May 17 17:10:28.189224 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 3/13] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 17 17:10:28 2022] GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:28.659136 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-64d08c15-9bd6-47af-a074-010440bcaa86 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:28.659511 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-64d08c15-9bd6-47af-a074-010440bcaa86 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:28.676446 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-64d08c15-9bd6-47af-a074-010440bcaa86 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:28.677288 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-64d08c15-9bd6-47af-a074-010440bcaa86 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:28.679142 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-64d08c15-9bd6-47af-a074-010440bcaa86 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:28.681209 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-64d08c15-9bd6-47af-a074-010440bcaa86 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:28.965195 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-64d08c15-9bd6-47af-a074-010440bcaa86 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:28.980194 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-64d08c15-9bd6-47af-a074-010440bcaa86 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1218 microversion: 2.1 time: 0.329650 May 17 17:10:28.981554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 11/14] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:28 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1218 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:29.202577 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ef2523e5-efb7-434d-a531-649857e19ada tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb18601310>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:29.337435 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ef2523e5-efb7-434d-a531-649857e19ada tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6" status: 200 len: 287 microversion: 2.1 time: 0.140280 May 17 17:10:29.341686 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 4/15] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 17 17:10:29 2022] GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 => generated 287 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:29.999400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e8f384c7-c687-45a3-abf4-425d9255b448 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:30.000728 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-e8f384c7-c687-45a3-abf4-425d9255b448 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:30.018670 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e8f384c7-c687-45a3-abf4-425d9255b448 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:30.019122 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e8f384c7-c687-45a3-abf4-425d9255b448 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:30.019938 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e8f384c7-c687-45a3-abf4-425d9255b448 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:30.020373 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e8f384c7-c687-45a3-abf4-425d9255b448 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:30.182566 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-e8f384c7-c687-45a3-abf4-425d9255b448 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:30.191167 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e8f384c7-c687-45a3-abf4-425d9255b448 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1218 microversion: 2.1 time: 0.196847 May 17 17:10:30.204067 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 12/16] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:29 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:10:30.349293 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8e255b70-1a13-47e7-a898-c287c4de9925 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb185f7dc0>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:30.413516 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8e255b70-1a13-47e7-a898-c287c4de9925 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6" status: 200 len: 287 microversion: 2.1 time: 0.069180 May 17 17:10:30.414086 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 5/17] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 17 17:10:30 2022] GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:30.726335 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5e0cd842-3db8-4db3-af7d-dfa66eaf6867 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Action: 'create', calling method: .version_select at 0x7feb19637310>, body: {"keypair": {"name": "tempest-keypair-1552181083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD78Ymr2uPREIUVIBQlHTtNkPjrv/m4w4ekNEuzKhzUVTyoywzHB+p39/EBQdH61tpMEYjlRrS4C46h/LzWXqQrQnf5VmXfWXtuByQVD7c+OAPyRPKddzKZoLZDKyp20yA=="}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:30.890675 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-5e0cd842-3db8-4db3-af7d-dfa66eaf6867 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Getting quotas for project 9d587d1ef11b4055b77055e6fbcc1899. Resources: {'key_pairs'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:10:30.922617 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-5e0cd842-3db8-4db3-af7d-dfa66eaf6867 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Getting quotas for user 86a0b6c88fe84ba0907d515fd9f38e72 and project 9d587d1ef11b4055b77055e6fbcc1899. Resources: {'key_pairs'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:10:31.043293 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5e0cd842-3db8-4db3-af7d-dfa66eaf6867 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.562522 May 17 17:10:31.047339 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 13/18] 10.222.0.48 () {62 vars in 1199 bytes} [Tue May 17 17:10:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 567 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 17 17:10:31.211525 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-48c8f44d-4655-406c-aa88-66ece51896b2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:31.212199 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-48c8f44d-4655-406c-aa88-66ece51896b2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:31.244925 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-48c8f44d-4655-406c-aa88-66ece51896b2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:31.251455 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-48c8f44d-4655-406c-aa88-66ece51896b2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:31.252331 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-48c8f44d-4655-406c-aa88-66ece51896b2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:31.252788 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-48c8f44d-4655-406c-aa88-66ece51896b2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:31.428756 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-05c86153-ffea-48f6-b735-315cddbf5e90 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb195cba60>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:31.493789 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-05c86153-ffea-48f6-b735-315cddbf5e90 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6" status: 200 len: 288 microversion: 2.1 time: 0.070318 May 17 17:10:31.496219 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 14/19] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 17 17:10:31 2022] GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:31.511296 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-177956f4-4da6-4b9e-b804-8697ebbf061c tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb18d740d0>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:31.719853 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-177956f4-4da6-4b9e-b804-8697ebbf061c tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6" status: 202 len: 0 microversion: 2.1 time: 0.214146 May 17 17:10:31.719853 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 15/20] 10.222.0.48 () {58 vars in 1253 bytes} [Tue May 17 17:10:31 2022] DELETE /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 17:10:31.727554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-213a04b4-edcf-42a7-865d-0dcf1d43f47d tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb18d74790>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:31.820965 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-213a04b4-edcf-42a7-865d-0dcf1d43f47d tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6" status: 200 len: 287 microversion: 2.1 time: 0.097930 May 17 17:10:31.821486 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 16/21] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 17 17:10:31 2022] GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:10:32.092480 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-48c8f44d-4655-406c-aa88-66ece51896b2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:32.137860 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-48c8f44d-4655-406c-aa88-66ece51896b2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1266 microversion: 2.1 time: 0.929666 May 17 17:10:32.149251 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 6/22] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:31 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1266 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:32.835380 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b74894c7-a35b-4a25-8d8f-5b8a75b78b1d tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb18d74e50>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:32.917364 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-b74894c7-a35b-4a25-8d8f-5b8a75b78b1d tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] HTTP exception thrown: Snapshot fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 could not be found. May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b74894c7-a35b-4a25-8d8f-5b8a75b78b1d tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Request method failure captured: May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 HTTP/1.1 May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9b6pPwNOKdPnEph0NWO_kilOgean0TzSQB1Beti3Lfg6gt0626T6FdgYD0njggvMS6lmwOrzo-ImvOKh3GngTMZ8g5aaWm1mrvOFVOfBrE70XnW_IOpnMzhsZcQ4AylZOSA5lV9S_W2L3praBByhC1szqzcaMNJxTsslEx04XiPSKI May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: db7972884e6b4df686b005676e6d1b7c May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-393019382 May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:10:32.925616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:10:32.926786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:10:32.926786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-VolumesSnapshotsTestJSON-393019382 May 17 17:10:32.926786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: db7972884e6b4df686b005676e6d1b7c May 17 17:10:32.926786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-393019382 May 17 17:10:32.926786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-VolumesSnapshotsTestJSON-393019382-project May 17 17:10:32.926786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:10:32.926786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:10:32.926786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 611d81db704b4f0ebc1fa0414d061925 May 17 17:10:32.926786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-VolumesSnapshotsTestJSON-393019382-project May 17 17:10:32.926786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: May 17 17:10:32.926786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Snapshot fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 could not be found. May 17 17:10:32.926786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': 'fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6'} May 17 17:10:32.926786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 could not be found. (HTTP 404) (Request-ID: req-a808b810-eb58-4061-9eef-25fe17c0b4ed) May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:32.927418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:10:32.929193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 could not be found. May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 17 17:10:32.930199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:10:32.934069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 could not be found. May 17 17:10:32.934069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:32.934069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:32.934069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:32.934069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:32.934069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:32.934069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:32.934069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:10:32.934069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:10:32.934069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 could not be found. May 17 17:10:32.934069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:32.934069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b74894c7-a35b-4a25-8d8f-5b8a75b78b1d tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Returning 404 to user: Snapshot fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:10:32.934069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b74894c7-a35b-4a25-8d8f-5b8a75b78b1d tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6" status: 404 len: 111 microversion: 2.1 time: 0.100593 May 17 17:10:32.934069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 17/23] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 17 17:10:32 2022] GET /compute/v2.1/os-snapshots/fbff8ed3-63ae-4087-b8ec-a2cac0c6aae6 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:10:32.959860 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-30adcaf4-c7bd-49d8-89c5-2e47b8b70510 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb19637280>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:33.173634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-30adcaf4-c7bd-49d8-89c5-2e47b8b70510 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358" status: 202 len: 0 microversion: 2.1 time: 0.237642 May 17 17:10:33.174772 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 18/24] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 17 17:10:32 2022] DELETE /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:10:33.180778 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a33deddb-adfd-40ac-9b16-8c1547a5aa5e tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:33.182269 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a33deddb-adfd-40ac-9b16-8c1547a5aa5e tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:33.203725 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a33deddb-adfd-40ac-9b16-8c1547a5aa5e tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:33.206078 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a33deddb-adfd-40ac-9b16-8c1547a5aa5e tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:33.211161 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a33deddb-adfd-40ac-9b16-8c1547a5aa5e tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:33.212692 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a33deddb-adfd-40ac-9b16-8c1547a5aa5e tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:33.287166 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1842655035", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:33.425101 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a33deddb-adfd-40ac-9b16-8c1547a5aa5e tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:33.435946 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a33deddb-adfd-40ac-9b16-8c1547a5aa5e tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1272 microversion: 2.1 time: 0.259650 May 17 17:10:33.449366 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] validate_networks() for [('d8fd1f2f-e54a-4844-8483-0ddae8800cdb', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:10:33.455161 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 19/25] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:33 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1272 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:33.479251 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f46f8b7e-ecd2-46f8-a310-32175715520e tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb18ce9550>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:33.656782 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f46f8b7e-ecd2-46f8-a310-32175715520e tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358" status: 200 len: 344 microversion: 2.1 time: 0.199630 May 17 17:10:33.662282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 20/26] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:10:33 2022] GET /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:33.866145 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d2eeec41-ff17-402a-87d1-6056bc38844a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Action: 'create', calling method: .version_select at 0x7feb18ce99d0>, body: {"keypair": {"name": "tempest-keypair-920688059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHOXrOLYv7FIe2fI1vlwbpcLdajF2g1jIalntVuk9/7zEBdxkFnFsxbg0wA67FTm0LGsxDD8ntrSZSuw2VzrrP7TSc0U6dRL8yJUhuhgejYPCbk3o7WXCr8Dhrf2Xg06A=="}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:33.881798 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-d2eeec41-ff17-402a-87d1-6056bc38844a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Getting quotas for project 87f2aabc0cda49538fa0fd9d5db6bf51. Resources: {'key_pairs'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:10:33.892812 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-d2eeec41-ff17-402a-87d1-6056bc38844a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Getting quotas for user 74cc0ddf89664a6f92c84ebb9e1ab3a2 and project 87f2aabc0cda49538fa0fd9d5db6bf51. Resources: {'key_pairs'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:10:33.937540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d2eeec41-ff17-402a-87d1-6056bc38844a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.140440 May 17 17:10:33.946193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 21/27] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 17 17:10:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:34.462381 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9403af13-672f-435e-b625-050afb59b966 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:34.463940 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9403af13-672f-435e-b625-050afb59b966 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:34.480066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9403af13-672f-435e-b625-050afb59b966 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:34.482205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9403af13-672f-435e-b625-050afb59b966 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:34.483217 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9403af13-672f-435e-b625-050afb59b966 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:34.487908 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9403af13-672f-435e-b625-050afb59b966 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:34.739188 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9403af13-672f-435e-b625-050afb59b966 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:34.752890 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9403af13-672f-435e-b625-050afb59b966 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1272 microversion: 2.1 time: 0.294951 May 17 17:10:34.765540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 22/28] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:34 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1272 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:34.782238 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-915b349b-8c9a-4bc8-a51f-6481114674ab tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb18cf6280>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:34.908596 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-915b349b-8c9a-4bc8-a51f-6481114674ab tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358" status: 200 len: 344 microversion: 2.1 time: 0.140972 May 17 17:10:34.915093 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 23/29] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:10:34 2022] GET /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:35.145068 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:10:35.145557 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:10:35.145972 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:10:35.146374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:10:35.147118 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:10:35.161872 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:35.162517 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:35.164335 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:35.166799 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:35.219415 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Getting quotas for project ea3305a913c541e4a45267497213df1c. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:10:35.232744 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Getting quotas for user 824915e26a724d938e5dd0a3c1f57932 and project ea3305a913c541e4a45267497213df1c. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:10:35.255229 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:10:35.258019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:10:35.348708 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8319cb99-6a0c-49a1-b5b6-b4eafdaac61c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.447362 May 17 17:10:35.355858 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 7/30] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:10:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:10:35.361548 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-efef8262-0288-4075-a930-f97bdb779a54 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:35.362734 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-efef8262-0288-4075-a930-f97bdb779a54 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:35.604758 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-efef8262-0288-4075-a930-f97bdb779a54 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:35.612189 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-efef8262-0288-4075-a930-f97bdb779a54 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1222 microversion: 2.1 time: 0.255391 May 17 17:10:35.618096 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 24/31] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:35 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1222 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:35.746413 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1995246669", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:35.772852 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-4900e711-1c85-4ca2-90d9-85a7bd26a1cf tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:35.773668 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-4900e711-1c85-4ca2-90d9-85a7bd26a1cf tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:35.804705 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4900e711-1c85-4ca2-90d9-85a7bd26a1cf tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:35.809417 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4900e711-1c85-4ca2-90d9-85a7bd26a1cf tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:35.812726 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4900e711-1c85-4ca2-90d9-85a7bd26a1cf tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:35.814814 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4900e711-1c85-4ca2-90d9-85a7bd26a1cf tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:35.975412 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] validate_networks() for [('d8fd1f2f-e54a-4844-8483-0ddae8800cdb', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:10:36.184127 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-4900e711-1c85-4ca2-90d9-85a7bd26a1cf tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:36.193726 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-4900e711-1c85-4ca2-90d9-85a7bd26a1cf tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1272 microversion: 2.1 time: 0.425396 May 17 17:10:36.211182 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 25/32] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:35 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1272 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:36.227174 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-22202fff-c1e5-434b-8ada-9fa482ceaafa tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb18cf64c0>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:36.302538 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-22202fff-c1e5-434b-8ada-9fa482ceaafa tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] HTTP exception thrown: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-22202fff-c1e5-434b-8ada-9fa482ceaafa tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Request method failure captured: May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358 HTTP/1.1 May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9b6pPwNOKdPnEph0NWO_kilOgean0TzSQB1Beti3Lfg6gt0626T6FdgYD0njggvMS6lmwOrzo-ImvOKh3GngTMZ8g5aaWm1mrvOFVOfBrE70XnW_IOpnMzhsZcQ4AylZOSA5lV9S_W2L3praBByhC1szqzcaMNJxTsslEx04XiPSKI May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: db7972884e6b4df686b005676e6d1b7c May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-393019382 May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:10:36.305070 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:10:36.306355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:10:36.306355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-VolumesSnapshotsTestJSON-393019382 May 17 17:10:36.306355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: db7972884e6b4df686b005676e6d1b7c May 17 17:10:36.306355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-393019382 May 17 17:10:36.306355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-VolumesSnapshotsTestJSON-393019382-project May 17 17:10:36.306355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:10:36.306355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:10:36.306355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 611d81db704b4f0ebc1fa0414d061925 May 17 17:10:36.306355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-VolumesSnapshotsTestJSON-393019382-project May 17 17:10:36.306355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: May 17 17:10:36.306355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.306355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '8971ca52-80d2-4462-b769-e257c726c358'} May 17 17:10:36.306355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. (HTTP 404) (Request-ID: req-2ef62b37-4200-483e-a89b-684dc3faf18d) May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:36.307048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:10:36.308323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 17:10:36.309479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:10:36.310918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.310918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.310918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:36.310918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.310918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:36.310918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:36.310918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:36.310918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:10:36.310918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:10:36.310918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.310918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.310918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-22202fff-c1e5-434b-8ada-9fa482ceaafa tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Returning 404 to user: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:10:36.310918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-22202fff-c1e5-434b-8ada-9fa482ceaafa tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358" status: 404 len: 109 microversion: 2.1 time: 0.094345 May 17 17:10:36.310918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 26/33] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:10:36 2022] GET /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:10:36.330286 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c04afc79-97b2-4247-8e0c-750ad4cb12d7 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb18ce9280>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:36.422675 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-c04afc79-97b2-4247-8e0c-750ad4cb12d7 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] HTTP exception thrown: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c04afc79-97b2-4247-8e0c-750ad4cb12d7 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Request method failure captured: May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: DELETE /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358 HTTP/1.1 May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9b6pPwNOKdPnEph0NWO_kilOgean0TzSQB1Beti3Lfg6gt0626T6FdgYD0njggvMS6lmwOrzo-ImvOKh3GngTMZ8g5aaWm1mrvOFVOfBrE70XnW_IOpnMzhsZcQ4AylZOSA5lV9S_W2L3praBByhC1szqzcaMNJxTsslEx04XiPSKI May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: db7972884e6b4df686b005676e6d1b7c May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-393019382 May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:10:36.424643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:10:36.425683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:10:36.425683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-VolumesSnapshotsTestJSON-393019382 May 17 17:10:36.425683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: db7972884e6b4df686b005676e6d1b7c May 17 17:10:36.425683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-393019382 May 17 17:10:36.425683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-VolumesSnapshotsTestJSON-393019382-project May 17 17:10:36.425683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:10:36.425683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:10:36.425683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 611d81db704b4f0ebc1fa0414d061925 May 17 17:10:36.425683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-VolumesSnapshotsTestJSON-393019382-project May 17 17:10:36.425683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: May 17 17:10:36.425683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.425683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '8971ca52-80d2-4462-b769-e257c726c358'} May 17 17:10:36.425683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. (HTTP 404) (Request-ID: req-cdfc5245-fa67-463c-a826-599bd74e4d8e) May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:36.426365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 17:10:36.427304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 17:10:36.428322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:10:36.429187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.429187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.429187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:36.429187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.429187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:36.429187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:36.429187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:36.429187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:10:36.429187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:10:36.429187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.429187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.429187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c04afc79-97b2-4247-8e0c-750ad4cb12d7 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Returning 404 to user: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:10:36.429187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c04afc79-97b2-4247-8e0c-750ad4cb12d7 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358" status: 404 len: 109 microversion: 2.1 time: 0.107228 May 17 17:10:36.430049 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 27/34] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 17 17:10:36 2022] DELETE /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:10:36.435105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3fdb150b-6612-4b6a-94f9-48a2a12b9882 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Calling method '.version_select at 0x7feb18cf65e0>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:36.528762 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-3fdb150b-6612-4b6a-94f9-48a2a12b9882 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] HTTP exception thrown: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3fdb150b-6612-4b6a-94f9-48a2a12b9882 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Request method failure captured: May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358 HTTP/1.1 May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9b6pPwNOKdPnEph0NWO_kilOgean0TzSQB1Beti3Lfg6gt0626T6FdgYD0njggvMS6lmwOrzo-ImvOKh3GngTMZ8g5aaWm1mrvOFVOfBrE70XnW_IOpnMzhsZcQ4AylZOSA5lV9S_W2L3praBByhC1szqzcaMNJxTsslEx04XiPSKI May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: db7972884e6b4df686b005676e6d1b7c May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-393019382 May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:10:36.531176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:10:36.532642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db7972884e6b4df686b005676e6d1b7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:10:36.532642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-VolumesSnapshotsTestJSON-393019382 May 17 17:10:36.532642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: db7972884e6b4df686b005676e6d1b7c May 17 17:10:36.532642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-393019382 May 17 17:10:36.532642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-VolumesSnapshotsTestJSON-393019382-project May 17 17:10:36.532642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:10:36.532642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:10:36.532642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 611d81db704b4f0ebc1fa0414d061925 May 17 17:10:36.532642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-VolumesSnapshotsTestJSON-393019382-project May 17 17:10:36.532642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: May 17 17:10:36.532642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.532642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '8971ca52-80d2-4462-b769-e257c726c358'} May 17 17:10:36.532642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. (HTTP 404) (Request-ID: req-a69c845d-c1ef-4a50-bb14-1983d254f90b) May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:36.533357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:10:36.534343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 17:10:36.535226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:10:36.536147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.536147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.536147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:36.536147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.536147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:36.536147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:36.536147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:36.536147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:10:36.536147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:10:36.536147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. May 17 17:10:36.536147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:36.538615 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3fdb150b-6612-4b6a-94f9-48a2a12b9882 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] Returning 404 to user: Volume 8971ca52-80d2-4462-b769-e257c726c358 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:10:36.540094 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-3fdb150b-6612-4b6a-94f9-48a2a12b9882 tempest-VolumesSnapshotsTestJSON-393019382 tempest-VolumesSnapshotsTestJSON-393019382-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358" status: 404 len: 109 microversion: 2.1 time: 0.108619 May 17 17:10:36.544582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 28/35] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:10:36 2022] GET /compute/v2.1/os-volumes/8971ca52-80d2-4462-b769-e257c726c358 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:10:37.236340 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-32a37814-f3fc-4ce5-88d3-be3969380334 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:37.236340 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-32a37814-f3fc-4ce5-88d3-be3969380334 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:37.250573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-32a37814-f3fc-4ce5-88d3-be3969380334 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:37.252832 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-32a37814-f3fc-4ce5-88d3-be3969380334 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:37.258830 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-32a37814-f3fc-4ce5-88d3-be3969380334 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:37.261842 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-32a37814-f3fc-4ce5-88d3-be3969380334 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:38.270580 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-32a37814-f3fc-4ce5-88d3-be3969380334 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:38.286146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-32a37814-f3fc-4ce5-88d3-be3969380334 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1272 microversion: 2.1 time: 1.069485 May 17 17:10:38.297872 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 29/36] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:37 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1272 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:38.327823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1099613803", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cabe2e00-7fdc-4f66-a15c-c9987c464947"}], "security_groups": [{"name": "tempest-securitygroup--1650020278"}], "key_name": "tempest-keypair-1552181083", "user_data": "}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:39.178191 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.network.neutron [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] validate_networks() for [('cabe2e00-7fdc-4f66-a15c-c9987c464947', None, None, None, None, None)] {{(pid=117090) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:10:40.519180 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:10:40.519919 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:10:40.520609 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:10:40.521136 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:10:40.521798 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:10:40.550626 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:40.555768 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:40.557909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:40.559831 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:40.620527 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Getting quotas for project ea3305a913c541e4a45267497213df1c. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:10:40.632045 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Getting quotas for user 824915e26a724d938e5dd0a3c1f57932 and project ea3305a913c541e4a45267497213df1c. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:10:40.679024 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:10:40.686402 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:10:40.824550 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0df75d31-fb43-4706-a64b-229023ffd279 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.084702 May 17 17:10:40.833381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 8/37] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:10:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 5094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:10:40.845379 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1040286799", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1dd4923f-bb48-4a70-ba63-f0b98efd2694"}], "security_groups": [{"name": "tempest-securitygroup--64763659"}], "key_name": "tempest-keypair-920688059", "user_data": "}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:41.479791 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] validate_networks() for [('1dd4923f-bb48-4a70-ba63-f0b98efd2694', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:10:43.242689 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:10:43.243848 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:10:43.244732 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:10:43.244847 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:10:43.245250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:10:43.269683 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:43.271921 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:43.277514 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:43.278006 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:43.355426 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Getting quotas for project 87f2aabc0cda49538fa0fd9d5db6bf51. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:10:43.367528 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Getting quotas for user 74cc0ddf89664a6f92c84ebb9e1ab3a2 and project 87f2aabc0cda49538fa0fd9d5db6bf51. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:10:43.413461 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:10:43.421978 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:10:43.575380 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2665022b-a7f7-4228-870b-a9b1b4ba3064 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.740463 May 17 17:10:43.577473 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 9/38] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:10:40 2022] POST /compute/v2.1/servers => generated 400 bytes in 2743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:10:43.590297 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-474a4acc-5d43-448e-89f9-826caace223f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:43.592040 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-474a4acc-5d43-448e-89f9-826caace223f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:43.606905 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-474a4acc-5d43-448e-89f9-826caace223f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:43.611977 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-474a4acc-5d43-448e-89f9-826caace223f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:43.613668 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-474a4acc-5d43-448e-89f9-826caace223f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:43.614298 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-474a4acc-5d43-448e-89f9-826caace223f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:44.520004 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-474a4acc-5d43-448e-89f9-826caace223f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:44.557460 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-474a4acc-5d43-448e-89f9-826caace223f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.978076 May 17 17:10:44.558279 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 10/39] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:43 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:44.564725 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4c1da6ef-8225-4735-a20b-fbac9bf1dfd2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:44.569664 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4c1da6ef-8225-4735-a20b-fbac9bf1dfd2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:44.572943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c1da6ef-8225-4735-a20b-fbac9bf1dfd2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:44.573976 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c1da6ef-8225-4735-a20b-fbac9bf1dfd2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:44.575998 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c1da6ef-8225-4735-a20b-fbac9bf1dfd2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:44.576590 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c1da6ef-8225-4735-a20b-fbac9bf1dfd2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:45.024257 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4c1da6ef-8225-4735-a20b-fbac9bf1dfd2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:45.049413 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4c1da6ef-8225-4735-a20b-fbac9bf1dfd2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1280 microversion: 2.1 time: 0.489940 May 17 17:10:45.070952 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 11/40] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:44 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1280 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:45.505562 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Flavor limits 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:10:45.506114 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Image limits 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:10:45.506878 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Flavor pref 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:10:45.506878 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Image pref 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:10:45.507309 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:10:45.574548 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:45.574937 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:45.575922 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:45.576503 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:45.678495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Getting quotas for project 9d587d1ef11b4055b77055e6fbcc1899. Resources: {'ram', 'instances', 'cores'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:10:45.693869 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Getting quotas for user 86a0b6c88fe84ba0907d515fd9f38e72 and project 9d587d1ef11b4055b77055e6fbcc1899. Resources: {'ram', 'instances', 'cores'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:10:45.736123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Going to run 1 instances... {{(pid=117090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:10:45.741399 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:10:45.822730 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-bee7f4a2-75e5-45f3-9f7d-1971014cf517 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Action: 'create', calling method: .version_select at 0x7feb18502550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-400860046", "metadata": {"Type": "work"}}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-bee7f4a2-75e5-45f3-9f7d-1971014cf517 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Request method failure captured: May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 121 May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9cSX-9fCZDOiha9qu4-RitlQMky5K7Xv7juxR3ufXkXt5qJOVHd1BbCwovMGGtlzc4Uh-6VL4xs0dbf7ZF5rk3cl1oP1DMZpfPZBEvkN8tmD1MoWwvqWXdESBof7vM3tyCoMxmhHJAKnFJibPvvx9ewKB_nhYzZbtyk42KF5xITv2I May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 9fb556e657784309a9f977cba20df9fa May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-VolumesNegativeTest-102072461 May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:10:45.860700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:10:45.861941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fb556e657784309a9f977cba20df9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:10:45.861941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-VolumesNegativeTest-102072461 May 17 17:10:45.861941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 9fb556e657784309a9f977cba20df9fa May 17 17:10:45.861941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-VolumesNegativeTest-102072461 May 17 17:10:45.861941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-VolumesNegativeTest-102072461-project May 17 17:10:45.861941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:10:45.861941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:10:45.861941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: e36386b1793a4cec81f0669aea3bcb30 May 17 17:10:45.861941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-VolumesNegativeTest-102072461-project May 17 17:10:45.861941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: May 17 17:10:45.861941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-400860046", "metadata": {"Type": "work"}}} May 17 17:10:45.861941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: May 17 17:10:45.861941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-400860046', 'metadata': {'Type': 'work'}}}} May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise error May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi '#$%' May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:10:45.862649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 17:10:45.863823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 17:10:45.864826 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 17:10:45.864826 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:45.864826 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-bee7f4a2-75e5-45f3-9f7d-1971014cf517 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:10:45.865335 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-bee7f4a2-75e5-45f3-9f7d-1971014cf517 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.791095 May 17 17:10:45.873782 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 12/41] 10.222.0.48 () {60 vars in 1155 bytes} [Tue May 17 17:10:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 801 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 17:10:45.896761 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0f7888b2-3033-4f5e-a1be-d17bac6802af tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:45.901501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0f7888b2-3033-4f5e-a1be-d17bac6802af tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:45.931939 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0f7888b2-3033-4f5e-a1be-d17bac6802af tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:45.934255 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0f7888b2-3033-4f5e-a1be-d17bac6802af tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:45.936465 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0f7888b2-3033-4f5e-a1be-d17bac6802af tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:45.936933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0f7888b2-3033-4f5e-a1be-d17bac6802af tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:45.973030 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c6b261bc-81a4-4442-84e6-4ef0d3c12a76 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 7.673756 May 17 17:10:45.974408 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 30/42] 10.222.0.48 () {62 vars in 1187 bytes} [Tue May 17 17:10:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 7676 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 17 17:10:45.990111 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-03787220-2426-4e25-94de-68bf1db1f98d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:45.991105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-03787220-2426-4e25-94de-68bf1db1f98d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:46.013270 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-03787220-2426-4e25-94de-68bf1db1f98d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:46.015203 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-03787220-2426-4e25-94de-68bf1db1f98d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:46.016708 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-03787220-2426-4e25-94de-68bf1db1f98d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:46.018575 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-03787220-2426-4e25-94de-68bf1db1f98d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:46.406126 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0f7888b2-3033-4f5e-a1be-d17bac6802af tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:46.474890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0f7888b2-3033-4f5e-a1be-d17bac6802af tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1289 microversion: 2.1 time: 0.599303 May 17 17:10:46.480379 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 13/43] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:45 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1289 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:46.502409 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4df411e6-8339-4258-b90d-75258f39f1ed tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Action: 'create', calling method: .version_select at 0x7feb18502d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-395071454", "metadata": {"Type": "work"}}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4df411e6-8339-4258-b90d-75258f39f1ed tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Request method failure captured: May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 119 May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9cSX-9fCZDOiha9qu4-RitlQMky5K7Xv7juxR3ufXkXt5qJOVHd1BbCwovMGGtlzc4Uh-6VL4xs0dbf7ZF5rk3cl1oP1DMZpfPZBEvkN8tmD1MoWwvqWXdESBof7vM3tyCoMxmhHJAKnFJibPvvx9ewKB_nhYzZbtyk42KF5xITv2I May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 9fb556e657784309a9f977cba20df9fa May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-VolumesNegativeTest-102072461 May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:10:46.523236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:10:46.524640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fb556e657784309a9f977cba20df9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:10:46.524640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-VolumesNegativeTest-102072461 May 17 17:10:46.524640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 9fb556e657784309a9f977cba20df9fa May 17 17:10:46.524640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-VolumesNegativeTest-102072461 May 17 17:10:46.524640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-VolumesNegativeTest-102072461-project May 17 17:10:46.524640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:10:46.524640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:10:46.524640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: e36386b1793a4cec81f0669aea3bcb30 May 17 17:10:46.524640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-VolumesNegativeTest-102072461-project May 17 17:10:46.524640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: May 17 17:10:46.524640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-395071454", "metadata": {"Type": "work"}}} May 17 17:10:46.524640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: May 17 17:10:46.524640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-395071454', 'metadata': {'Type': 'work'}}}} May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise error May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi '0' May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:10:46.525421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 17:10:46.526529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 17:10:46.527463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 17:10:46.527463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:46.527463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4df411e6-8339-4258-b90d-75258f39f1ed tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:10:46.527463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4df411e6-8339-4258-b90d-75258f39f1ed tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025348 May 17 17:10:46.527463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 14/44] 10.222.0.48 () {60 vars in 1155 bytes} [Tue May 17 17:10:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 17:10:46.558105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-03787220-2426-4e25-94de-68bf1db1f98d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:46.560360 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7111c323-8a8a-4ca1-bae9-d609f140c953 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:46.565848 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-03787220-2426-4e25-94de-68bf1db1f98d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.589763 May 17 17:10:46.568440 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7111c323-8a8a-4ca1-bae9-d609f140c953 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:46.569310 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 31/45] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:45 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:46.595320 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d7bae2af-dc29-43c3-be64-992202341777 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:46.596235 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d7bae2af-dc29-43c3-be64-992202341777 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:46.607575 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d7bae2af-dc29-43c3-be64-992202341777 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:46.611785 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d7bae2af-dc29-43c3-be64-992202341777 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:46.613087 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d7bae2af-dc29-43c3-be64-992202341777 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:46.613494 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d7bae2af-dc29-43c3-be64-992202341777 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:46.823415 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7111c323-8a8a-4ca1-bae9-d609f140c953 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:46.853319 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7111c323-8a8a-4ca1-bae9-d609f140c953 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:46.873722 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7111c323-8a8a-4ca1-bae9-d609f140c953 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:46.890779 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7111c323-8a8a-4ca1-bae9-d609f140c953 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1282 microversion: 2.20 time: 0.381564 May 17 17:10:46.899640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 15/46] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:10:46 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1282 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:10:46.921468 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-18966c4e-7e9b-4fd0-be96-3eaca9e1a8a1 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Action: 'create', calling method: .version_select at 0x7feb185025e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-744448445", "metadata": {"Type": "work"}}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-18966c4e-7e9b-4fd0-be96-3eaca9e1a8a1 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Request method failure captured: May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 118 May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9cSX-9fCZDOiha9qu4-RitlQMky5K7Xv7juxR3ufXkXt5qJOVHd1BbCwovMGGtlzc4Uh-6VL4xs0dbf7ZF5rk3cl1oP1DMZpfPZBEvkN8tmD1MoWwvqWXdESBof7vM3tyCoMxmhHJAKnFJibPvvx9ewKB_nhYzZbtyk42KF5xITv2I May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 9fb556e657784309a9f977cba20df9fa May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-VolumesNegativeTest-102072461 May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:10:46.930165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:10:46.931739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fb556e657784309a9f977cba20df9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:10:46.931739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-VolumesNegativeTest-102072461 May 17 17:10:46.931739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 9fb556e657784309a9f977cba20df9fa May 17 17:10:46.931739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-VolumesNegativeTest-102072461 May 17 17:10:46.931739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-VolumesNegativeTest-102072461-project May 17 17:10:46.931739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:10:46.931739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:10:46.931739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: e36386b1793a4cec81f0669aea3bcb30 May 17 17:10:46.931739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-VolumesNegativeTest-102072461-project May 17 17:10:46.931739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: May 17 17:10:46.931739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-744448445", "metadata": {"Type": "work"}}} May 17 17:10:46.931739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: May 17 17:10:46.931739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-744448445', 'metadata': {'Type': 'work'}}}} May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise error May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi '' May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:10:46.932536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 17:10:46.933879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 17:10:46.934963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 17:10:46.934963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:46.934963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-18966c4e-7e9b-4fd0-be96-3eaca9e1a8a1 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:10:46.936909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-18966c4e-7e9b-4fd0-be96-3eaca9e1a8a1 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030986 May 17 17:10:46.946716 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 16/47] 10.222.0.48 () {60 vars in 1155 bytes} [Tue May 17 17:10:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 17:10:46.967888 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ffd39bab-e539-4904-af55-8b1311825dd3 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Calling method '.version_select at 0x7feb184dee50>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:47.066482 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-ffd39bab-e539-4904-af55-8b1311825dd3 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] HTTP exception thrown: Volume tempest-invalid-366217690 could not be found. May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ffd39bab-e539-4904-af55-8b1311825dd3 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Request method failure captured: May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-366217690 HTTP/1.1 May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9cSX-9fCZDOiha9qu4-RitlQMky5K7Xv7juxR3ufXkXt5qJOVHd1BbCwovMGGtlzc4Uh-6VL4xs0dbf7ZF5rk3cl1oP1DMZpfPZBEvkN8tmD1MoWwvqWXdESBof7vM3tyCoMxmhHJAKnFJibPvvx9ewKB_nhYzZbtyk42KF5xITv2I May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 9fb556e657784309a9f977cba20df9fa May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-VolumesNegativeTest-102072461 May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:10:47.070240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:10:47.071950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fb556e657784309a9f977cba20df9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:10:47.071950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-VolumesNegativeTest-102072461 May 17 17:10:47.071950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 9fb556e657784309a9f977cba20df9fa May 17 17:10:47.071950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-VolumesNegativeTest-102072461 May 17 17:10:47.071950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-VolumesNegativeTest-102072461-project May 17 17:10:47.071950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:10:47.071950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:10:47.071950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: e36386b1793a4cec81f0669aea3bcb30 May 17 17:10:47.071950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-VolumesNegativeTest-102072461-project May 17 17:10:47.071950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: May 17 17:10:47.071950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Volume tempest-invalid-366217690 could not be found. May 17 17:10:47.071950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': 'tempest-invalid-366217690'} May 17 17:10:47.071950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-366217690 could not be found. (HTTP 404) (Request-ID: req-04814e0c-9e3a-4d95-8585-33505ac09ab6) May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:47.072680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 17:10:47.078906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-366217690 could not be found. May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:10:47.080223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-366217690 could not be found. May 17 17:10:47.081373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:47.081373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:47.081373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:47.081373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:47.081373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:47.081373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:47.081373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:10:47.081373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:10:47.081373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-366217690 could not be found. May 17 17:10:47.081373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:47.081373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ffd39bab-e539-4904-af55-8b1311825dd3 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Returning 404 to user: Volume tempest-invalid-366217690 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:10:47.081373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ffd39bab-e539-4904-af55-8b1311825dd3 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-366217690" status: 404 len: 98 microversion: 2.1 time: 0.124527 May 17 17:10:47.081373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 17/48] 10.222.0.48 () {58 vars in 1214 bytes} [Tue May 17 17:10:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-366217690 => generated 98 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 17 17:10:47.089856 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a423cf4e-0766-47ec-b13e-ac19f64e00e3 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010730 May 17 17:10:47.104756 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 18/49] 10.222.0.48 () {58 vars in 1139 bytes} [Tue May 17 17:10:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 17 17:10:47.113347 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-55ee1181-e8d4-4c2a-ad20-7954725d81c3 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005371 May 17 17:10:47.119442 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 19/50] 10.222.0.48 () {58 vars in 1136 bytes} [Tue May 17 17:10:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 17 17:10:47.130532 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a07e38ac-5e0b-4781-b3fc-28a1b7e2d18a tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Calling method '.version_select at 0x7feb18556700>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:47.208985 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d7bae2af-dc29-43c3-be64-992202341777 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:47.218446 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d7bae2af-dc29-43c3-be64-992202341777 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1280 microversion: 2.1 time: 0.636351 May 17 17:10:47.220226 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-a07e38ac-5e0b-4781-b3fc-28a1b7e2d18a tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] HTTP exception thrown: Volume b852741c-3b00-46d7-bf50-252aeda0e4fa could not be found. May 17 17:10:47.222648 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 32/51] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:46 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1280 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a07e38ac-5e0b-4781-b3fc-28a1b7e2d18a tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Request method failure captured: May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: DELETE /compute/v2.1/os-volumes/b852741c-3b00-46d7-bf50-252aeda0e4fa HTTP/1.1 May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9cSX-9fCZDOiha9qu4-RitlQMky5K7Xv7juxR3ufXkXt5qJOVHd1BbCwovMGGtlzc4Uh-6VL4xs0dbf7ZF5rk3cl1oP1DMZpfPZBEvkN8tmD1MoWwvqWXdESBof7vM3tyCoMxmhHJAKnFJibPvvx9ewKB_nhYzZbtyk42KF5xITv2I May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 9fb556e657784309a9f977cba20df9fa May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-VolumesNegativeTest-102072461 May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:10:47.223227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:10:47.224565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fb556e657784309a9f977cba20df9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:10:47.224565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-VolumesNegativeTest-102072461 May 17 17:10:47.224565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 9fb556e657784309a9f977cba20df9fa May 17 17:10:47.224565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-VolumesNegativeTest-102072461 May 17 17:10:47.224565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-VolumesNegativeTest-102072461-project May 17 17:10:47.224565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:10:47.224565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:10:47.224565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: e36386b1793a4cec81f0669aea3bcb30 May 17 17:10:47.224565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-VolumesNegativeTest-102072461-project May 17 17:10:47.224565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: May 17 17:10:47.224565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Volume b852741c-3b00-46d7-bf50-252aeda0e4fa could not be found. May 17 17:10:47.224565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': 'b852741c-3b00-46d7-bf50-252aeda0e4fa'} May 17 17:10:47.224565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b852741c-3b00-46d7-bf50-252aeda0e4fa could not be found. (HTTP 404) (Request-ID: req-57f232af-c000-4e1b-9104-122acd90b84f) May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:47.225359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 17:10:47.226522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b852741c-3b00-46d7-bf50-252aeda0e4fa could not be found. May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 17:10:47.227937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:10:47.229121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b852741c-3b00-46d7-bf50-252aeda0e4fa could not be found. May 17 17:10:47.229121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:47.229121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:47.229121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:47.229121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:47.229121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:47.229121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:47.229121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:10:47.229121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:10:47.229121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b852741c-3b00-46d7-bf50-252aeda0e4fa could not be found. May 17 17:10:47.229121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:10:47.230767 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a07e38ac-5e0b-4781-b3fc-28a1b7e2d18a tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Returning 404 to user: Volume b852741c-3b00-46d7-bf50-252aeda0e4fa could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:10:47.231852 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a07e38ac-5e0b-4781-b3fc-28a1b7e2d18a tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/b852741c-3b00-46d7-bf50-252aeda0e4fa" status: 404 len: 109 microversion: 2.1 time: 0.105505 May 17 17:10:47.234349 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 20/52] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 17 17:10:47 2022] DELETE /compute/v2.1/os-volumes/b852741c-3b00-46d7-bf50-252aeda0e4fa => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 17:10:47.246654 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-bc0d345b-af67-4a63-a277-68d9c24c6052 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Calling method '.version_select at 0x7feb1842b310>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:47.319999 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-bc0d345b-af67-4a63-a277-68d9c24c6052 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] HTTP exception thrown: Volume 507f3217-38c9-4341-ab48-fc3af15d3f76 could not be found. May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-bc0d345b-af67-4a63-a277-68d9c24c6052 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Request method failure captured: May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/os-volumes/507f3217-38c9-4341-ab48-fc3af15d3f76 HTTP/1.1 May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9cSX-9fCZDOiha9qu4-RitlQMky5K7Xv7juxR3ufXkXt5qJOVHd1BbCwovMGGtlzc4Uh-6VL4xs0dbf7ZF5rk3cl1oP1DMZpfPZBEvkN8tmD1MoWwvqWXdESBof7vM3tyCoMxmhHJAKnFJibPvvx9ewKB_nhYzZbtyk42KF5xITv2I May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 9fb556e657784309a9f977cba20df9fa May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-VolumesNegativeTest-102072461 May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:10:47.323196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:10:47.324577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fb556e657784309a9f977cba20df9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fb556e657784309a9f977cba20df9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:10:47.324577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-VolumesNegativeTest-102072461 May 17 17:10:47.324577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 9fb556e657784309a9f977cba20df9fa May 17 17:10:47.324577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-VolumesNegativeTest-102072461 May 17 17:10:47.324577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-VolumesNegativeTest-102072461-project May 17 17:10:47.324577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:10:47.324577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:10:47.324577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: e36386b1793a4cec81f0669aea3bcb30 May 17 17:10:47.324577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-VolumesNegativeTest-102072461-project May 17 17:10:47.324577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: May 17 17:10:47.324577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Volume 507f3217-38c9-4341-ab48-fc3af15d3f76 could not be found. May 17 17:10:47.324577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '507f3217-38c9-4341-ab48-fc3af15d3f76'} May 17 17:10:47.324577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 507f3217-38c9-4341-ab48-fc3af15d3f76 could not be found. (HTTP 404) (Request-ID: req-6ba9cd8d-313e-43b9-b320-866e647444c8) May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:47.325444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:10:47.326559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 507f3217-38c9-4341-ab48-fc3af15d3f76 could not be found. May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 17:10:47.327677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:10:47.328887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 507f3217-38c9-4341-ab48-fc3af15d3f76 could not be found. May 17 17:10:47.328887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:47.328887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:10:47.328887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:47.328887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:10:47.328887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:10:47.328887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:10:47.328887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:10:47.328887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:10:47.328887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 507f3217-38c9-4341-ab48-fc3af15d3f76 could not be found. May 17 17:10:47.328887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:10:47.340118 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-bc0d345b-af67-4a63-a277-68d9c24c6052 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] Returning 404 to user: Volume 507f3217-38c9-4341-ab48-fc3af15d3f76 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:10:47.340118 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-bc0d345b-af67-4a63-a277-68d9c24c6052 tempest-VolumesNegativeTest-102072461 tempest-VolumesNegativeTest-102072461-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/507f3217-38c9-4341-ab48-fc3af15d3f76" status: 404 len: 109 microversion: 2.1 time: 0.089492 May 17 17:10:47.340118 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 33/53] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:10:47 2022] GET /compute/v2.1/os-volumes/507f3217-38c9-4341-ab48-fc3af15d3f76 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 17:10:47.498844 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ab1b5430-a66d-4d36-a951-efa4eff0fa79 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:47.499673 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ab1b5430-a66d-4d36-a951-efa4eff0fa79 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:47.513162 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ab1b5430-a66d-4d36-a951-efa4eff0fa79 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:47.513162 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ab1b5430-a66d-4d36-a951-efa4eff0fa79 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:47.526692 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ab1b5430-a66d-4d36-a951-efa4eff0fa79 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:47.527434 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ab1b5430-a66d-4d36-a951-efa4eff0fa79 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:47.586760 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9aaba557-c478-495d-b742-80257be1847c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:47.588754 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9aaba557-c478-495d-b742-80257be1847c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:47.604167 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9aaba557-c478-495d-b742-80257be1847c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:47.612184 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9aaba557-c478-495d-b742-80257be1847c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:47.613539 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9aaba557-c478-495d-b742-80257be1847c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:47.614245 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9aaba557-c478-495d-b742-80257be1847c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:47.797177 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ab1b5430-a66d-4d36-a951-efa4eff0fa79 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:47.811447 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ab1b5430-a66d-4d36-a951-efa4eff0fa79 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1295 microversion: 2.1 time: 0.317960 May 17 17:10:47.812156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 21/54] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:47 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1295 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:47.935235 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-158efde8-b344-429f-bc53-c23c1e1ebb5a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:47.936337 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-158efde8-b344-429f-bc53-c23c1e1ebb5a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:47.945110 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-158efde8-b344-429f-bc53-c23c1e1ebb5a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:47.945572 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-158efde8-b344-429f-bc53-c23c1e1ebb5a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:47.951696 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-158efde8-b344-429f-bc53-c23c1e1ebb5a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:47.953842 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-158efde8-b344-429f-bc53-c23c1e1ebb5a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:48.176527 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-158efde8-b344-429f-bc53-c23c1e1ebb5a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:48.186908 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-158efde8-b344-429f-bc53-c23c1e1ebb5a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:48.192832 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-158efde8-b344-429f-bc53-c23c1e1ebb5a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:48.198747 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-158efde8-b344-429f-bc53-c23c1e1ebb5a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1334 microversion: 2.20 time: 0.280646 May 17 17:10:48.210259 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 22/55] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:10:47 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1334 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:10:48.240031 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-dcacfb90-d9c1-497b-b1f9-72883efd3a5b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:48.240943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-dcacfb90-d9c1-497b-b1f9-72883efd3a5b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:48.250949 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dcacfb90-d9c1-497b-b1f9-72883efd3a5b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:48.255149 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dcacfb90-d9c1-497b-b1f9-72883efd3a5b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:48.256260 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dcacfb90-d9c1-497b-b1f9-72883efd3a5b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:48.262654 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dcacfb90-d9c1-497b-b1f9-72883efd3a5b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:48.289203 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9aaba557-c478-495d-b742-80257be1847c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:48.297990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9aaba557-c478-495d-b742-80257be1847c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.715443 May 17 17:10:48.304113 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 34/56] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:47 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:48.804114 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-dcacfb90-d9c1-497b-b1f9-72883efd3a5b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:48.820334 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-dcacfb90-d9c1-497b-b1f9-72883efd3a5b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.584277 May 17 17:10:48.844913 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 23/57] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:48 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:48.852166 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1b3fe059-d89a-4b2b-8a60-1160da86a7ca tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:48.853313 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1b3fe059-d89a-4b2b-8a60-1160da86a7ca tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:48.870761 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1b3fe059-d89a-4b2b-8a60-1160da86a7ca tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:48.871264 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1b3fe059-d89a-4b2b-8a60-1160da86a7ca tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:48.881569 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1b3fe059-d89a-4b2b-8a60-1160da86a7ca tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:48.882166 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1b3fe059-d89a-4b2b-8a60-1160da86a7ca tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:49.143952 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-dd088af7-988b-41dc-8cdd-17d11bca7333 req-c2b6bfb4-34ee-420e-913d-14188df8393c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8fba30-1d0b-43ea-ad0c-11129104e39b", "tag": "43c4a27e-6ab5-4983-a112-df5a98db82e8"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:49.192236 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-dd088af7-988b-41dc-8cdd-17d11bca7333 req-c2b6bfb4-34ee-420e-913d-14188df8393c service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:49.192745 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-dd088af7-988b-41dc-8cdd-17d11bca7333 req-c2b6bfb4-34ee-420e-913d-14188df8393c service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:49.224407 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1b3fe059-d89a-4b2b-8a60-1160da86a7ca tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:49.236097 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1b3fe059-d89a-4b2b-8a60-1160da86a7ca tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1295 microversion: 2.1 time: 0.389811 May 17 17:10:49.239691 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 24/58] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:48 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1295 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:49.245162 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-fcc12858-f75c-4d63-a94b-9f2db8561054 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:49.249050 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-fcc12858-f75c-4d63-a94b-9f2db8561054 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:49.253266 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-dd088af7-988b-41dc-8cdd-17d11bca7333 req-c2b6bfb4-34ee-420e-913d-14188df8393c service nova] Creating event network-changed:43c4a27e-6ab5-4983-a112-df5a98db82e8 for instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b on hv-cinder-84214 May 17 17:10:49.253904 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-dd088af7-988b-41dc-8cdd-17d11bca7333 req-c2b6bfb4-34ee-420e-913d-14188df8393c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117090) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 17 17:10:49.262149 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90f9fcad-4eee-4921-9768-bdeaeab68977 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:49.262819 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90f9fcad-4eee-4921-9768-bdeaeab68977 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:49.264876 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fcc12858-f75c-4d63-a94b-9f2db8561054 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:49.268992 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90f9fcad-4eee-4921-9768-bdeaeab68977 None None] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:49.269525 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90f9fcad-4eee-4921-9768-bdeaeab68977 None None] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:49.270451 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fcc12858-f75c-4d63-a94b-9f2db8561054 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:49.271594 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fcc12858-f75c-4d63-a94b-9f2db8561054 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:49.276311 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fcc12858-f75c-4d63-a94b-9f2db8561054 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:49.309817 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.compute.rpcapi [None req-90f9fcad-4eee-4921-9768-bdeaeab68977 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 17 17:10:49.314348 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90f9fcad-4eee-4921-9768-bdeaeab68977 None None] Releasing lock "compute-rpcapi-router" {{(pid=117090) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 17 17:10:49.361665 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-90f9fcad-4eee-4921-9768-bdeaeab68977 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.810341 May 17 17:10:49.362999 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 35/59] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:10:49.370416 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f03bba8e-9307-46b3-8eed-9a4c9246dca9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:49.371506 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f03bba8e-9307-46b3-8eed-9a4c9246dca9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:49.387852 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f03bba8e-9307-46b3-8eed-9a4c9246dca9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:49.389342 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f03bba8e-9307-46b3-8eed-9a4c9246dca9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:49.393295 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f03bba8e-9307-46b3-8eed-9a4c9246dca9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:49.394032 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f03bba8e-9307-46b3-8eed-9a4c9246dca9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:49.481367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-fcc12858-f75c-4d63-a94b-9f2db8561054 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:49.493455 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-fcc12858-f75c-4d63-a94b-9f2db8561054 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:49.502996 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-fcc12858-f75c-4d63-a94b-9f2db8561054 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:49.505275 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-fcc12858-f75c-4d63-a94b-9f2db8561054 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1340 microversion: 2.20 time: 0.262128 May 17 17:10:49.507906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 25/60] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:10:49 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1340 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:10:49.847483 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b2fbdc8c-ef7c-4b86-baad-996f2bddbfa8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:49.847483 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-b2fbdc8c-ef7c-4b86-baad-996f2bddbfa8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:49.863138 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b2fbdc8c-ef7c-4b86-baad-996f2bddbfa8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:49.868472 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b2fbdc8c-ef7c-4b86-baad-996f2bddbfa8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:49.869791 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b2fbdc8c-ef7c-4b86-baad-996f2bddbfa8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:49.882510 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b2fbdc8c-ef7c-4b86-baad-996f2bddbfa8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:50.109275 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f03bba8e-9307-46b3-8eed-9a4c9246dca9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:50.143092 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f03bba8e-9307-46b3-8eed-9a4c9246dca9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.778436 May 17 17:10:50.148969 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 36/61] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:49 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:50.339941 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-5edd6a83-8982-41a6-ba19-a88d22558e7a req-a763ef06-db68-4855-9962-598c755420e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d096e1-5210-41e8-ae6e-dee03652b474", "tag": "a023c407-040e-4e16-b8de-6dc1de12fc09"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:50.368711 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-5edd6a83-8982-41a6-ba19-a88d22558e7a req-a763ef06-db68-4855-9962-598c755420e8 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:50.370204 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-5edd6a83-8982-41a6-ba19-a88d22558e7a req-a763ef06-db68-4855-9962-598c755420e8 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:50.417648 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-5edd6a83-8982-41a6-ba19-a88d22558e7a req-a763ef06-db68-4855-9962-598c755420e8 service nova] Creating event network-changed:a023c407-040e-4e16-b8de-6dc1de12fc09 for instance 09d096e1-5210-41e8-ae6e-dee03652b474 on hv-cinder-84214 May 17 17:10:50.440879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-5edd6a83-8982-41a6-ba19-a88d22558e7a req-a763ef06-db68-4855-9962-598c755420e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242194 May 17 17:10:50.442551 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 37/62] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:10:50.453990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-77b3bd5f-f703-45b4-95bd-e26dc1f86aec tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:50.456928 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-77b3bd5f-f703-45b4-95bd-e26dc1f86aec tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:50.472235 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-77b3bd5f-f703-45b4-95bd-e26dc1f86aec tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:50.472739 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-77b3bd5f-f703-45b4-95bd-e26dc1f86aec tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:50.473554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-77b3bd5f-f703-45b4-95bd-e26dc1f86aec tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:50.490317 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-77b3bd5f-f703-45b4-95bd-e26dc1f86aec tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:50.622009 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-b2fbdc8c-ef7c-4b86-baad-996f2bddbfa8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:50.647491 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-b2fbdc8c-ef7c-4b86-baad-996f2bddbfa8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.808305 May 17 17:10:50.657448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 26/63] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:49 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:10:50.674460 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d4547331-85a3-4030-9c8e-09e7a61122d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:50.675181 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d4547331-85a3-4030-9c8e-09e7a61122d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:50.682545 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d4547331-85a3-4030-9c8e-09e7a61122d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:50.698259 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d4547331-85a3-4030-9c8e-09e7a61122d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:50.699334 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d4547331-85a3-4030-9c8e-09e7a61122d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:50.699897 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d4547331-85a3-4030-9c8e-09e7a61122d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:51.156609 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-77b3bd5f-f703-45b4-95bd-e26dc1f86aec tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:51.182905 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-77b3bd5f-f703-45b4-95bd-e26dc1f86aec tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1295 microversion: 2.1 time: 0.724793 May 17 17:10:51.183956 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 38/64] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:50 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1295 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:51.203503 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ebb068f3-412f-4b8e-8cae-1b743a9000c8 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:51.205376 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ebb068f3-412f-4b8e-8cae-1b743a9000c8 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:51.230143 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ebb068f3-412f-4b8e-8cae-1b743a9000c8 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:51.230604 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ebb068f3-412f-4b8e-8cae-1b743a9000c8 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:51.231750 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ebb068f3-412f-4b8e-8cae-1b743a9000c8 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:51.232392 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ebb068f3-412f-4b8e-8cae-1b743a9000c8 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:51.619246 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ebb068f3-412f-4b8e-8cae-1b743a9000c8 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:51.631011 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ebb068f3-412f-4b8e-8cae-1b743a9000c8 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.439604 May 17 17:10:51.636098 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 39/65] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:51 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:51.673686 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c1974ea2-7389-4b60-8c5c-7f269061dc8e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:51.674394 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c1974ea2-7389-4b60-8c5c-7f269061dc8e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:51.690128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c1974ea2-7389-4b60-8c5c-7f269061dc8e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:51.692485 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c1974ea2-7389-4b60-8c5c-7f269061dc8e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:51.694090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c1974ea2-7389-4b60-8c5c-7f269061dc8e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:51.716792 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c1974ea2-7389-4b60-8c5c-7f269061dc8e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:51.805673 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d4547331-85a3-4030-9c8e-09e7a61122d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:51.814914 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d4547331-85a3-4030-9c8e-09e7a61122d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:51.830271 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d4547331-85a3-4030-9c8e-09e7a61122d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:51.834957 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d4547331-85a3-4030-9c8e-09e7a61122d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 1.176266 May 17 17:10:51.835561 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 27/66] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:10:50 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:10:52.203565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-371b3238-4ed2-44d5-8a7d-f5e2acadd7fe tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:52.204885 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-371b3238-4ed2-44d5-8a7d-f5e2acadd7fe tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:52.225924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-371b3238-4ed2-44d5-8a7d-f5e2acadd7fe tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:52.229453 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-371b3238-4ed2-44d5-8a7d-f5e2acadd7fe tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:52.231394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-371b3238-4ed2-44d5-8a7d-f5e2acadd7fe tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:52.232596 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-371b3238-4ed2-44d5-8a7d-f5e2acadd7fe tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:52.392012 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c1974ea2-7389-4b60-8c5c-7f269061dc8e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:52.405551 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c1974ea2-7389-4b60-8c5c-7f269061dc8e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.742011 May 17 17:10:52.406311 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 40/67] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:51 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:52.649628 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-80d6e52d-4d59-45b5-bae0-4a924cf9c057 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:52.650252 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-80d6e52d-4d59-45b5-bae0-4a924cf9c057 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:52.668235 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-80d6e52d-4d59-45b5-bae0-4a924cf9c057 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:52.668690 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-80d6e52d-4d59-45b5-bae0-4a924cf9c057 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:52.669668 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-80d6e52d-4d59-45b5-bae0-4a924cf9c057 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:52.670948 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-80d6e52d-4d59-45b5-bae0-4a924cf9c057 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:52.728633 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-371b3238-4ed2-44d5-8a7d-f5e2acadd7fe tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:52.751023 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-371b3238-4ed2-44d5-8a7d-f5e2acadd7fe tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.545326 May 17 17:10:52.751958 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 28/68] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:52 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:10:52.859081 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9c0f10fd-b892-48fb-94f4-98a9e7f824c6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:52.860544 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9c0f10fd-b892-48fb-94f4-98a9e7f824c6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:52.870843 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9c0f10fd-b892-48fb-94f4-98a9e7f824c6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:52.873498 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9c0f10fd-b892-48fb-94f4-98a9e7f824c6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:52.874664 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9c0f10fd-b892-48fb-94f4-98a9e7f824c6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:52.877647 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9c0f10fd-b892-48fb-94f4-98a9e7f824c6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:53.736627 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-80d6e52d-4d59-45b5-bae0-4a924cf9c057 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:53.744838 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-80d6e52d-4d59-45b5-bae0-4a924cf9c057 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 1.099025 May 17 17:10:53.745426 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 41/69] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:52 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:10:53.755888 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-583f731e-9840-4f27-b532-79bc13d2c7e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:53.756506 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-583f731e-9840-4f27-b532-79bc13d2c7e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:53.792973 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-583f731e-9840-4f27-b532-79bc13d2c7e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:53.793442 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-583f731e-9840-4f27-b532-79bc13d2c7e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:53.794250 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-583f731e-9840-4f27-b532-79bc13d2c7e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:53.794695 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-583f731e-9840-4f27-b532-79bc13d2c7e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:53.816124 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9c0f10fd-b892-48fb-94f4-98a9e7f824c6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:53.825144 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9c0f10fd-b892-48fb-94f4-98a9e7f824c6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:53.826682 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9c0f10fd-b892-48fb-94f4-98a9e7f824c6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:53.834679 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9c0f10fd-b892-48fb-94f4-98a9e7f824c6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.982980 May 17 17:10:53.849481 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 29/70] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:10:52 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:10:53.854327 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-26c0cdeb-9067-4b62-995b-2f50e6d4de95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:53.854952 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-26c0cdeb-9067-4b62-995b-2f50e6d4de95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:53.878431 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-26c0cdeb-9067-4b62-995b-2f50e6d4de95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:53.879049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-26c0cdeb-9067-4b62-995b-2f50e6d4de95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:53.879695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-26c0cdeb-9067-4b62-995b-2f50e6d4de95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:53.880356 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-26c0cdeb-9067-4b62-995b-2f50e6d4de95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:54.303629 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-583f731e-9840-4f27-b532-79bc13d2c7e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:54.311273 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-26c0cdeb-9067-4b62-995b-2f50e6d4de95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:54.319831 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-26c0cdeb-9067-4b62-995b-2f50e6d4de95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.469717 May 17 17:10:54.329862 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 30/71] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:53 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:54.336045 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-583f731e-9840-4f27-b532-79bc13d2c7e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.589489 May 17 17:10:54.342732 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-a2ae85ee-81f1-47d4-ac6f-7272d51b699a req-c6b3078d-6298-4874-93a6-3bd1e975f140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e0001f-f7bc-4b5c-8083-c72723f1d8d4", "tag": "1efef679-0e58-4dd9-94e3-c4f323122713"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:54.343099 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 42/72] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:53 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:54.402646 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-a2ae85ee-81f1-47d4-ac6f-7272d51b699a req-c6b3078d-6298-4874-93a6-3bd1e975f140 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:54.404516 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-a2ae85ee-81f1-47d4-ac6f-7272d51b699a req-c6b3078d-6298-4874-93a6-3bd1e975f140 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:54.425332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-a5486aa3-9f50-4c3b-975d-892ae9a8f9b9 req-07d95112-3238-44f5-b472-dceaa6136fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b074c961-149b-4667-addc-790568769b88", "tag": "e6735ae1-4241-48ca-9802-22aba7b4cccc"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:54.449492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-a5486aa3-9f50-4c3b-975d-892ae9a8f9b9 req-07d95112-3238-44f5-b472-dceaa6136fb3 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:54.451336 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-a5486aa3-9f50-4c3b-975d-892ae9a8f9b9 req-07d95112-3238-44f5-b472-dceaa6136fb3 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:54.455694 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-a2ae85ee-81f1-47d4-ac6f-7272d51b699a req-c6b3078d-6298-4874-93a6-3bd1e975f140 service nova] Creating event network-changed:1efef679-0e58-4dd9-94e3-c4f323122713 for instance 58e0001f-f7bc-4b5c-8083-c72723f1d8d4 on hv-cinder-84214 May 17 17:10:54.456650 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-a2ae85ee-81f1-47d4-ac6f-7272d51b699a req-c6b3078d-6298-4874-93a6-3bd1e975f140 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117089) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 17 17:10:54.462567 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fdfc6130-4102-4229-b6d9-73e982a712c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:54.463391 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fdfc6130-4102-4229-b6d9-73e982a712c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:54.464649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fdfc6130-4102-4229-b6d9-73e982a712c6 None None] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:54.467776 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fdfc6130-4102-4229-b6d9-73e982a712c6 None None] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:54.494663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-a5486aa3-9f50-4c3b-975d-892ae9a8f9b9 req-07d95112-3238-44f5-b472-dceaa6136fb3 service nova] Creating event network-changed:e6735ae1-4241-48ca-9802-22aba7b4cccc for instance b074c961-149b-4667-addc-790568769b88 on hv-cinder-84214 May 17 17:10:54.496302 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.compute.rpcapi [None req-fdfc6130-4102-4229-b6d9-73e982a712c6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 17 17:10:54.499750 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fdfc6130-4102-4229-b6d9-73e982a712c6 None None] Releasing lock "compute-rpcapi-router" {{(pid=117089) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 17 17:10:54.506192 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-a5486aa3-9f50-4c3b-975d-892ae9a8f9b9 req-07d95112-3238-44f5-b472-dceaa6136fb3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084942 May 17 17:10:54.509401 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 43/73] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:54.564635 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-fdfc6130-4102-4229-b6d9-73e982a712c6 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233423 May 17 17:10:54.565732 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 31/74] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:54.768986 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8c6f7f3f-d9d5-4df7-8f0d-876286467952 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:54.770785 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8c6f7f3f-d9d5-4df7-8f0d-876286467952 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:54.788243 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8c6f7f3f-d9d5-4df7-8f0d-876286467952 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:54.789014 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8c6f7f3f-d9d5-4df7-8f0d-876286467952 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:54.793478 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8c6f7f3f-d9d5-4df7-8f0d-876286467952 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:54.796763 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8c6f7f3f-d9d5-4df7-8f0d-876286467952 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:54.856040 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3a928f58-e992-4288-ae21-f7359868aac2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:54.856896 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3a928f58-e992-4288-ae21-f7359868aac2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:54.879718 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a928f58-e992-4288-ae21-f7359868aac2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:54.881579 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a928f58-e992-4288-ae21-f7359868aac2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:54.882711 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a928f58-e992-4288-ae21-f7359868aac2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:54.889222 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a928f58-e992-4288-ae21-f7359868aac2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:55.475160 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8c6f7f3f-d9d5-4df7-8f0d-876286467952 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:55.488997 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8c6f7f3f-d9d5-4df7-8f0d-876286467952 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.728791 May 17 17:10:55.502767 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 44/75] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:54 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:55.509927 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-81729f2e-f24f-41cd-8556-effe9aedd896 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:55.511276 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-81729f2e-f24f-41cd-8556-effe9aedd896 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:55.518155 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-81729f2e-f24f-41cd-8556-effe9aedd896 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:55.518989 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-81729f2e-f24f-41cd-8556-effe9aedd896 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:55.520128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-81729f2e-f24f-41cd-8556-effe9aedd896 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:55.520572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-81729f2e-f24f-41cd-8556-effe9aedd896 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:55.637092 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3a928f58-e992-4288-ae21-f7359868aac2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:55.650367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3a928f58-e992-4288-ae21-f7359868aac2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:55.652404 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3a928f58-e992-4288-ae21-f7359868aac2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:55.657665 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3a928f58-e992-4288-ae21-f7359868aac2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.807124 May 17 17:10:55.672068 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 32/76] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:10:54 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:10:55.681188 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-07c5dde3-d286-4b27-ac98-47b7d572e9d3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:55.684002 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-07c5dde3-d286-4b27-ac98-47b7d572e9d3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:55.692630 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-07c5dde3-d286-4b27-ac98-47b7d572e9d3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:55.693339 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-07c5dde3-d286-4b27-ac98-47b7d572e9d3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:55.694563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-07c5dde3-d286-4b27-ac98-47b7d572e9d3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:55.695158 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-07c5dde3-d286-4b27-ac98-47b7d572e9d3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:55.849105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-81729f2e-f24f-41cd-8556-effe9aedd896 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:55.858593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-81729f2e-f24f-41cd-8556-effe9aedd896 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.353654 May 17 17:10:55.859514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 45/77] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:55 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:56.019953 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-07c5dde3-d286-4b27-ac98-47b7d572e9d3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:56.029742 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-07c5dde3-d286-4b27-ac98-47b7d572e9d3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.355843 May 17 17:10:56.038510 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 33/78] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:55 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:56.511431 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-bb67c959-18a1-4889-b0a9-d53a364f757f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:56.512322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-bb67c959-18a1-4889-b0a9-d53a364f757f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:56.519860 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bb67c959-18a1-4889-b0a9-d53a364f757f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:56.520233 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bb67c959-18a1-4889-b0a9-d53a364f757f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:56.521069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bb67c959-18a1-4889-b0a9-d53a364f757f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:56.521656 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bb67c959-18a1-4889-b0a9-d53a364f757f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:56.639228 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-6cf56bc8-a8f0-407a-8a19-a11b3c2b6992 req-a8605203-1ca6-4f7e-a49f-ec167e19bb32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee2bb8d5-d263-4ab1-8778-77fc4a30f388", "tag": "a1ea561d-09ff-4ccb-94e1-a73a746f4900"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:10:56.647479 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-6cf56bc8-a8f0-407a-8a19-a11b3c2b6992 req-a8605203-1ca6-4f7e-a49f-ec167e19bb32 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:56.648086 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-6cf56bc8-a8f0-407a-8a19-a11b3c2b6992 req-a8605203-1ca6-4f7e-a49f-ec167e19bb32 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:56.659742 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-6cf56bc8-a8f0-407a-8a19-a11b3c2b6992 req-a8605203-1ca6-4f7e-a49f-ec167e19bb32 service nova] Creating event network-changed:a1ea561d-09ff-4ccb-94e1-a73a746f4900 for instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 on hv-cinder-84214 May 17 17:10:56.665977 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-6cf56bc8-a8f0-407a-8a19-a11b3c2b6992 req-a8605203-1ca6-4f7e-a49f-ec167e19bb32 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030201 May 17 17:10:56.666974 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 34/79] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:10:56.682165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e2b3ee52-653b-4865-bed4-5551d52d094d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:56.682986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e2b3ee52-653b-4865-bed4-5551d52d094d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:56.690851 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e2b3ee52-653b-4865-bed4-5551d52d094d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:56.691526 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e2b3ee52-653b-4865-bed4-5551d52d094d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:56.692557 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e2b3ee52-653b-4865-bed4-5551d52d094d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:56.692806 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-bb67c959-18a1-4889-b0a9-d53a364f757f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:56.693446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e2b3ee52-653b-4865-bed4-5551d52d094d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:56.717335 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-bb67c959-18a1-4889-b0a9-d53a364f757f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.212160 May 17 17:10:56.718135 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 46/80] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:56 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:56.876470 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-cbbb0c34-9218-4d0c-971b-16fb1caff133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:56.878139 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-cbbb0c34-9218-4d0c-971b-16fb1caff133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:56.885196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-cbbb0c34-9218-4d0c-971b-16fb1caff133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:56.886001 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-cbbb0c34-9218-4d0c-971b-16fb1caff133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:56.886996 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-cbbb0c34-9218-4d0c-971b-16fb1caff133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:56.887735 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-cbbb0c34-9218-4d0c-971b-16fb1caff133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:56.894186 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e2b3ee52-653b-4865-bed4-5551d52d094d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:56.916753 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e2b3ee52-653b-4865-bed4-5551d52d094d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:56.918464 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e2b3ee52-653b-4865-bed4-5551d52d094d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:56.919834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e2b3ee52-653b-4865-bed4-5551d52d094d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.244941 May 17 17:10:56.933302 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 35/81] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:10:56 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:10:57.048813 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-60ad94b8-6e1b-4fa3-82f8-c2a0e673af49 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:57.051169 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-60ad94b8-6e1b-4fa3-82f8-c2a0e673af49 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:57.058368 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-cbbb0c34-9218-4d0c-971b-16fb1caff133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:57.068947 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-cbbb0c34-9218-4d0c-971b-16fb1caff133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.196168 May 17 17:10:57.079953 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-60ad94b8-6e1b-4fa3-82f8-c2a0e673af49 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:57.080408 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-60ad94b8-6e1b-4fa3-82f8-c2a0e673af49 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:57.081195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-60ad94b8-6e1b-4fa3-82f8-c2a0e673af49 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:57.081637 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-60ad94b8-6e1b-4fa3-82f8-c2a0e673af49 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:57.085985 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 47/82] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:56 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:10:57.247545 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-60ad94b8-6e1b-4fa3-82f8-c2a0e673af49 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:57.255942 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-60ad94b8-6e1b-4fa3-82f8-c2a0e673af49 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.213048 May 17 17:10:57.256920 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 36/83] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:57 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:10:57.737963 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c914e649-6c23-4328-ad9a-ba6a74257325 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:57.739354 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c914e649-6c23-4328-ad9a-ba6a74257325 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:57.747679 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c914e649-6c23-4328-ad9a-ba6a74257325 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:57.748822 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c914e649-6c23-4328-ad9a-ba6a74257325 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:57.749788 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c914e649-6c23-4328-ad9a-ba6a74257325 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:57.750397 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c914e649-6c23-4328-ad9a-ba6a74257325 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:57.917407 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c914e649-6c23-4328-ad9a-ba6a74257325 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:57.926574 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c914e649-6c23-4328-ad9a-ba6a74257325 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.194932 May 17 17:10:57.928411 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 48/84] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:57 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:57.943198 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-51b25c74-9423-41f8-8582-a15e1dcb9faa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:57.943913 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-51b25c74-9423-41f8-8582-a15e1dcb9faa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:57.951072 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-51b25c74-9423-41f8-8582-a15e1dcb9faa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:57.951517 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-51b25c74-9423-41f8-8582-a15e1dcb9faa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:57.952319 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-51b25c74-9423-41f8-8582-a15e1dcb9faa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:57.952756 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-51b25c74-9423-41f8-8582-a15e1dcb9faa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:58.088400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e7978073-8a77-45d8-aea5-d6a290c3b905 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:58.089388 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-e7978073-8a77-45d8-aea5-d6a290c3b905 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:58.107886 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e7978073-8a77-45d8-aea5-d6a290c3b905 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:58.108964 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e7978073-8a77-45d8-aea5-d6a290c3b905 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:58.110781 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e7978073-8a77-45d8-aea5-d6a290c3b905 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:58.112769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e7978073-8a77-45d8-aea5-d6a290c3b905 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:58.538413 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-51b25c74-9423-41f8-8582-a15e1dcb9faa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:58.548730 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-51b25c74-9423-41f8-8582-a15e1dcb9faa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:58.559741 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-51b25c74-9423-41f8-8582-a15e1dcb9faa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:58.562106 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-51b25c74-9423-41f8-8582-a15e1dcb9faa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.621641 May 17 17:10:58.565078 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 37/85] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:10:57 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:10:58.574587 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1afc4d2e-c7f4-4d6b-b6e1-32e05e65cf1f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:58.576724 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1afc4d2e-c7f4-4d6b-b6e1-32e05e65cf1f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:58.593759 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1afc4d2e-c7f4-4d6b-b6e1-32e05e65cf1f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:58.595086 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1afc4d2e-c7f4-4d6b-b6e1-32e05e65cf1f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:58.596124 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1afc4d2e-c7f4-4d6b-b6e1-32e05e65cf1f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:58.596780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1afc4d2e-c7f4-4d6b-b6e1-32e05e65cf1f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:58.668692 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-e7978073-8a77-45d8-aea5-d6a290c3b905 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:58.676987 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e7978073-8a77-45d8-aea5-d6a290c3b905 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.594379 May 17 17:10:58.678122 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 49/86] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:58 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:58.754417 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1afc4d2e-c7f4-4d6b-b6e1-32e05e65cf1f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:58.762437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1afc4d2e-c7f4-4d6b-b6e1-32e05e65cf1f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.196249 May 17 17:10:58.763019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 38/87] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:58 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:58.946624 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-997650e0-4cbf-4f2c-96cc-be169fc5e0af tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:58.947937 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-997650e0-4cbf-4f2c-96cc-be169fc5e0af tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:58.954362 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-997650e0-4cbf-4f2c-96cc-be169fc5e0af tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:58.955123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-997650e0-4cbf-4f2c-96cc-be169fc5e0af tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:58.955984 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-997650e0-4cbf-4f2c-96cc-be169fc5e0af tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:58.956591 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-997650e0-4cbf-4f2c-96cc-be169fc5e0af tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:59.108687 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-997650e0-4cbf-4f2c-96cc-be169fc5e0af tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:59.116527 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-997650e0-4cbf-4f2c-96cc-be169fc5e0af tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.174946 May 17 17:10:59.117106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 50/88] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:58 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:10:59.584130 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2fc65c0e-f632-4d87-b338-52a3a9f8073a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:59.585587 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2fc65c0e-f632-4d87-b338-52a3a9f8073a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:59.594283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2fc65c0e-f632-4d87-b338-52a3a9f8073a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:59.599275 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2fc65c0e-f632-4d87-b338-52a3a9f8073a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:59.599275 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2fc65c0e-f632-4d87-b338-52a3a9f8073a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:59.599275 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2fc65c0e-f632-4d87-b338-52a3a9f8073a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:59.696324 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d530717b-be7c-4871-a1ec-38cfa3cf3c8f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:59.697056 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d530717b-be7c-4871-a1ec-38cfa3cf3c8f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:59.711097 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d530717b-be7c-4871-a1ec-38cfa3cf3c8f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:59.711580 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d530717b-be7c-4871-a1ec-38cfa3cf3c8f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:59.712416 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d530717b-be7c-4871-a1ec-38cfa3cf3c8f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:59.712847 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d530717b-be7c-4871-a1ec-38cfa3cf3c8f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:59.764136 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2fc65c0e-f632-4d87-b338-52a3a9f8073a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:59.777429 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2fc65c0e-f632-4d87-b338-52a3a9f8073a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:59.779385 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2fc65c0e-f632-4d87-b338-52a3a9f8073a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:59.780818 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2fc65c0e-f632-4d87-b338-52a3a9f8073a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.201557 May 17 17:10:59.793008 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 39/89] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:10:59 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:10:59.799224 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7e401eac-d0b6-487e-ba1c-6739ebc8c367 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:10:59.799224 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7e401eac-d0b6-487e-ba1c-6739ebc8c367 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:10:59.806810 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e401eac-d0b6-487e-ba1c-6739ebc8c367 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:59.807274 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e401eac-d0b6-487e-ba1c-6739ebc8c367 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:59.808089 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e401eac-d0b6-487e-ba1c-6739ebc8c367 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:10:59.808562 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e401eac-d0b6-487e-ba1c-6739ebc8c367 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:10:59.908180 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d530717b-be7c-4871-a1ec-38cfa3cf3c8f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:10:59.921910 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d530717b-be7c-4871-a1ec-38cfa3cf3c8f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.230432 May 17 17:10:59.922987 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 51/90] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:59 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:00.001727 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7e401eac-d0b6-487e-ba1c-6739ebc8c367 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:00.012327 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7e401eac-d0b6-487e-ba1c-6739ebc8c367 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.218093 May 17 17:11:00.012911 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 40/91] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:10:59 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:00.137901 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c3d7813e-7215-4665-a1b6-133a450a26fa tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:00.139176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c3d7813e-7215-4665-a1b6-133a450a26fa tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:00.145316 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c3d7813e-7215-4665-a1b6-133a450a26fa tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:00.146041 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c3d7813e-7215-4665-a1b6-133a450a26fa tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:00.146834 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c3d7813e-7215-4665-a1b6-133a450a26fa tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:00.147273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c3d7813e-7215-4665-a1b6-133a450a26fa tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:00.354768 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c3d7813e-7215-4665-a1b6-133a450a26fa tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:00.364406 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c3d7813e-7215-4665-a1b6-133a450a26fa tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.233184 May 17 17:11:00.365095 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 52/92] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:00 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:00.800391 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-69e00410-12e3-471d-859e-497ff1ac5caa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:00.800995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-69e00410-12e3-471d-859e-497ff1ac5caa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:00.810128 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-69e00410-12e3-471d-859e-497ff1ac5caa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:00.810576 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-69e00410-12e3-471d-859e-497ff1ac5caa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:00.811853 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-69e00410-12e3-471d-859e-497ff1ac5caa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:00.812471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-69e00410-12e3-471d-859e-497ff1ac5caa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:00.940467 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-6d977d7d-2e30-45cb-acba-90cb00c8de53 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:00.941076 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-6d977d7d-2e30-45cb-acba-90cb00c8de53 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:00.948364 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6d977d7d-2e30-45cb-acba-90cb00c8de53 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:00.949126 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6d977d7d-2e30-45cb-acba-90cb00c8de53 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:00.950215 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6d977d7d-2e30-45cb-acba-90cb00c8de53 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:00.950838 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6d977d7d-2e30-45cb-acba-90cb00c8de53 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:00.980721 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-69e00410-12e3-471d-859e-497ff1ac5caa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:00.990052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-69e00410-12e3-471d-859e-497ff1ac5caa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:00.997564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-69e00410-12e3-471d-859e-497ff1ac5caa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:01.002742 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-69e00410-12e3-471d-859e-497ff1ac5caa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.206157 May 17 17:11:01.014749 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 41/93] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:11:00 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:11:01.029733 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7b7b85e8-ad48-4883-9cfc-b80cc8eb9993 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:01.032806 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7b7b85e8-ad48-4883-9cfc-b80cc8eb9993 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:01.046692 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7b7b85e8-ad48-4883-9cfc-b80cc8eb9993 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:01.048720 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7b7b85e8-ad48-4883-9cfc-b80cc8eb9993 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:01.050745 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7b7b85e8-ad48-4883-9cfc-b80cc8eb9993 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:01.051546 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7b7b85e8-ad48-4883-9cfc-b80cc8eb9993 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:01.492697 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7b7b85e8-ad48-4883-9cfc-b80cc8eb9993 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:01.502816 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7b7b85e8-ad48-4883-9cfc-b80cc8eb9993 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.476814 May 17 17:11:01.504522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 42/94] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:01 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:01.519506 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-6d977d7d-2e30-45cb-acba-90cb00c8de53 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:01.536057 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a1f88090-514d-4180-9fd0-a820bf399e24 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:01.537408 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a1f88090-514d-4180-9fd0-a820bf399e24 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:01.540193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-6d977d7d-2e30-45cb-acba-90cb00c8de53 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.602017 May 17 17:11:01.541941 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 53/95] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:00 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:01.547131 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a1f88090-514d-4180-9fd0-a820bf399e24 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:01.547878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a1f88090-514d-4180-9fd0-a820bf399e24 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:01.549032 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a1f88090-514d-4180-9fd0-a820bf399e24 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:01.549661 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a1f88090-514d-4180-9fd0-a820bf399e24 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:01.937561 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a1f88090-514d-4180-9fd0-a820bf399e24 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:01.947867 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a1f88090-514d-4180-9fd0-a820bf399e24 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.441179 May 17 17:11:01.950504 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 43/96] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:01 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:02.027437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b063c9ae-73bf-4a55-b421-052b921888f0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:02.028380 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b063c9ae-73bf-4a55-b421-052b921888f0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:02.052172 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b063c9ae-73bf-4a55-b421-052b921888f0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:02.052649 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b063c9ae-73bf-4a55-b421-052b921888f0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:02.056302 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b063c9ae-73bf-4a55-b421-052b921888f0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:02.056935 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b063c9ae-73bf-4a55-b421-052b921888f0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:02.215848 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b063c9ae-73bf-4a55-b421-052b921888f0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:02.223908 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b063c9ae-73bf-4a55-b421-052b921888f0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:02.225535 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b063c9ae-73bf-4a55-b421-052b921888f0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:02.226857 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b063c9ae-73bf-4a55-b421-052b921888f0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.206542 May 17 17:11:02.227441 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 54/97] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:11:02 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:11:02.522285 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-406cafdf-c432-410d-ae3e-3ec34dacfa36 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:02.522951 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-406cafdf-c432-410d-ae3e-3ec34dacfa36 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:02.529371 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-406cafdf-c432-410d-ae3e-3ec34dacfa36 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:02.529827 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-406cafdf-c432-410d-ae3e-3ec34dacfa36 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:02.530638 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-406cafdf-c432-410d-ae3e-3ec34dacfa36 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:02.531152 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-406cafdf-c432-410d-ae3e-3ec34dacfa36 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:02.561465 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-be0a7fc5-5f52-44a4-8f28-075b6f553fe6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:02.562266 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-be0a7fc5-5f52-44a4-8f28-075b6f553fe6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:02.591738 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-be0a7fc5-5f52-44a4-8f28-075b6f553fe6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:02.592433 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-be0a7fc5-5f52-44a4-8f28-075b6f553fe6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:02.593580 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-be0a7fc5-5f52-44a4-8f28-075b6f553fe6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:02.594227 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-be0a7fc5-5f52-44a4-8f28-075b6f553fe6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:02.802083 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-406cafdf-c432-410d-ae3e-3ec34dacfa36 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:02.813414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-406cafdf-c432-410d-ae3e-3ec34dacfa36 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.293956 May 17 17:11:02.814184 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 44/98] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:02 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:02.856741 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-be0a7fc5-5f52-44a4-8f28-075b6f553fe6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:02.864338 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-be0a7fc5-5f52-44a4-8f28-075b6f553fe6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.309215 May 17 17:11:02.864796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 55/99] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:02 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:02.967302 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6a3ec1d0-9a2e-421c-a740-ba6f7208b14c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:02.967901 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6a3ec1d0-9a2e-421c-a740-ba6f7208b14c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:02.977251 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6a3ec1d0-9a2e-421c-a740-ba6f7208b14c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:02.977251 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6a3ec1d0-9a2e-421c-a740-ba6f7208b14c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:02.977251 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6a3ec1d0-9a2e-421c-a740-ba6f7208b14c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:02.977251 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6a3ec1d0-9a2e-421c-a740-ba6f7208b14c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:03.125625 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6a3ec1d0-9a2e-421c-a740-ba6f7208b14c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:03.135551 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6a3ec1d0-9a2e-421c-a740-ba6f7208b14c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.171191 May 17 17:11:03.135551 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 45/100] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:02 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:03.245908 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-45d5d51c-1907-497e-afb9-a4950c29583e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:03.246748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-45d5d51c-1907-497e-afb9-a4950c29583e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:03.256254 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-45d5d51c-1907-497e-afb9-a4950c29583e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:03.256254 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-45d5d51c-1907-497e-afb9-a4950c29583e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:03.256254 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-45d5d51c-1907-497e-afb9-a4950c29583e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:03.256254 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-45d5d51c-1907-497e-afb9-a4950c29583e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:03.453955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-45d5d51c-1907-497e-afb9-a4950c29583e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:03.462228 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-45d5d51c-1907-497e-afb9-a4950c29583e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:03.464605 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-45d5d51c-1907-497e-afb9-a4950c29583e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:03.466249 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-45d5d51c-1907-497e-afb9-a4950c29583e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.224703 May 17 17:11:03.478394 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 56/101] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:11:03 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:11:03.565929 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-c8cef653-17e3-4c28-bcd6-b4731cba9f96 req-885951bb-22b3-48fd-95aa-4fccc4af3784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d096e1-5210-41e8-ae6e-dee03652b474", "name": "network-vif-plugged", "status": "completed", "tag": "a023c407-040e-4e16-b8de-6dc1de12fc09"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:03.574928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-c8cef653-17e3-4c28-bcd6-b4731cba9f96 req-885951bb-22b3-48fd-95aa-4fccc4af3784 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:03.575395 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-c8cef653-17e3-4c28-bcd6-b4731cba9f96 req-885951bb-22b3-48fd-95aa-4fccc4af3784 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:03.588871 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-c8cef653-17e3-4c28-bcd6-b4731cba9f96 req-885951bb-22b3-48fd-95aa-4fccc4af3784 service nova] Creating event network-vif-plugged:a023c407-040e-4e16-b8de-6dc1de12fc09 for instance 09d096e1-5210-41e8-ae6e-dee03652b474 on hv-cinder-84214 May 17 17:11:03.594667 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-c8cef653-17e3-4c28-bcd6-b4731cba9f96 req-885951bb-22b3-48fd-95aa-4fccc4af3784 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107252 May 17 17:11:03.595798 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 46/102] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:11:03.831585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-23ef3bf2-8918-47fe-9e0e-2a575e6fb637 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:03.832230 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-23ef3bf2-8918-47fe-9e0e-2a575e6fb637 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:03.839036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-23ef3bf2-8918-47fe-9e0e-2a575e6fb637 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:03.839771 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-23ef3bf2-8918-47fe-9e0e-2a575e6fb637 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:03.840543 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-23ef3bf2-8918-47fe-9e0e-2a575e6fb637 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:03.841144 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-23ef3bf2-8918-47fe-9e0e-2a575e6fb637 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:03.882042 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-c721a274-6e52-48ec-b847-aa233f481a31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:03.883535 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-c721a274-6e52-48ec-b847-aa233f481a31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:03.892883 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c721a274-6e52-48ec-b847-aa233f481a31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:03.893438 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c721a274-6e52-48ec-b847-aa233f481a31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:03.894392 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c721a274-6e52-48ec-b847-aa233f481a31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:03.894919 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c721a274-6e52-48ec-b847-aa233f481a31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:04.042979 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-23ef3bf2-8918-47fe-9e0e-2a575e6fb637 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:04.051326 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-23ef3bf2-8918-47fe-9e0e-2a575e6fb637 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.223957 May 17 17:11:04.052182 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 57/103] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:03 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:04.102893 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-c721a274-6e52-48ec-b847-aa233f481a31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:04.111001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-c721a274-6e52-48ec-b847-aa233f481a31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.233548 May 17 17:11:04.111583 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 47/104] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:03 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:04.152454 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-77bfead3-f83d-4e3a-ba55-ee0a151ca521 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:04.153204 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-77bfead3-f83d-4e3a-ba55-ee0a151ca521 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:04.159470 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-77bfead3-f83d-4e3a-ba55-ee0a151ca521 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:04.160198 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-77bfead3-f83d-4e3a-ba55-ee0a151ca521 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:04.160979 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-77bfead3-f83d-4e3a-ba55-ee0a151ca521 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:04.161424 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-77bfead3-f83d-4e3a-ba55-ee0a151ca521 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:04.297963 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-77bfead3-f83d-4e3a-ba55-ee0a151ca521 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:04.305936 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-77bfead3-f83d-4e3a-ba55-ee0a151ca521 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.157595 May 17 17:11:04.306627 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 58/105] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:04 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:04.486059 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6d4cb793-45d9-4c45-bb1f-5406e8e98521 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:04.486680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6d4cb793-45d9-4c45-bb1f-5406e8e98521 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:04.497616 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d4cb793-45d9-4c45-bb1f-5406e8e98521 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:04.498074 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d4cb793-45d9-4c45-bb1f-5406e8e98521 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:04.499299 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d4cb793-45d9-4c45-bb1f-5406e8e98521 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:04.499299 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d4cb793-45d9-4c45-bb1f-5406e8e98521 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:04.669626 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6d4cb793-45d9-4c45-bb1f-5406e8e98521 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:04.679356 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6d4cb793-45d9-4c45-bb1f-5406e8e98521 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:04.681774 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6d4cb793-45d9-4c45-bb1f-5406e8e98521 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:04.682915 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6d4cb793-45d9-4c45-bb1f-5406e8e98521 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.200937 May 17 17:11:04.683899 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 48/106] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:11:04 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:11:05.068248 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7db23b45-f6e8-4107-ad88-964616102adc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:05.069540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7db23b45-f6e8-4107-ad88-964616102adc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:05.076460 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7db23b45-f6e8-4107-ad88-964616102adc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:05.076816 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7db23b45-f6e8-4107-ad88-964616102adc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:05.078351 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7db23b45-f6e8-4107-ad88-964616102adc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:05.078800 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7db23b45-f6e8-4107-ad88-964616102adc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:05.129206 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8e2e9a29-5f8c-415f-a2b3-8b52f76d2adc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:05.130802 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8e2e9a29-5f8c-415f-a2b3-8b52f76d2adc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:05.138217 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8e2e9a29-5f8c-415f-a2b3-8b52f76d2adc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:05.138746 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8e2e9a29-5f8c-415f-a2b3-8b52f76d2adc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:05.139692 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8e2e9a29-5f8c-415f-a2b3-8b52f76d2adc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:05.140399 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8e2e9a29-5f8c-415f-a2b3-8b52f76d2adc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:05.262368 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7db23b45-f6e8-4107-ad88-964616102adc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:05.276831 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7db23b45-f6e8-4107-ad88-964616102adc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.212371 May 17 17:11:05.277421 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 59/107] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:05 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:05.299886 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-8e2e9a29-5f8c-415f-a2b3-8b52f76d2adc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:05.307980 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8e2e9a29-5f8c-415f-a2b3-8b52f76d2adc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.182594 May 17 17:11:05.308549 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 49/108] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:05 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:05.324960 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a13edcf4-c26b-40e3-b298-574bc151def9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:05.325672 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a13edcf4-c26b-40e3-b298-574bc151def9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:05.332649 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a13edcf4-c26b-40e3-b298-574bc151def9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:05.333093 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a13edcf4-c26b-40e3-b298-574bc151def9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:05.333888 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a13edcf4-c26b-40e3-b298-574bc151def9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:05.334319 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a13edcf4-c26b-40e3-b298-574bc151def9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:05.469600 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a13edcf4-c26b-40e3-b298-574bc151def9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:05.477811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a13edcf4-c26b-40e3-b298-574bc151def9 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.158209 May 17 17:11:05.478619 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 60/109] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:05 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:05.627070 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-c56b08b0-1322-439a-84e5-dbdfcbad2cf3 req-17f4d0a2-3361-44bd-a860-2b949710f46c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8fba30-1d0b-43ea-ad0c-11129104e39b", "name": "network-vif-plugged", "status": "completed", "tag": "43c4a27e-6ab5-4983-a112-df5a98db82e8"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:05.637099 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-c56b08b0-1322-439a-84e5-dbdfcbad2cf3 req-17f4d0a2-3361-44bd-a860-2b949710f46c service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:05.637917 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-c56b08b0-1322-439a-84e5-dbdfcbad2cf3 req-17f4d0a2-3361-44bd-a860-2b949710f46c service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:05.651822 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-c56b08b0-1322-439a-84e5-dbdfcbad2cf3 req-17f4d0a2-3361-44bd-a860-2b949710f46c service nova] Creating event network-vif-plugged:43c4a27e-6ab5-4983-a112-df5a98db82e8 for instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b on hv-cinder-84214 May 17 17:11:05.656661 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-c56b08b0-1322-439a-84e5-dbdfcbad2cf3 req-17f4d0a2-3361-44bd-a860-2b949710f46c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034034 May 17 17:11:05.657455 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 50/110] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:11:05.707159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-acfbd478-d930-41f8-8c6a-030d802463e6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:05.708271 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-acfbd478-d930-41f8-8c6a-030d802463e6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:05.714996 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-acfbd478-d930-41f8-8c6a-030d802463e6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:05.715647 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-acfbd478-d930-41f8-8c6a-030d802463e6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:05.716749 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-acfbd478-d930-41f8-8c6a-030d802463e6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:05.717329 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-acfbd478-d930-41f8-8c6a-030d802463e6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:05.871229 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-acfbd478-d930-41f8-8c6a-030d802463e6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:05.879152 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-acfbd478-d930-41f8-8c6a-030d802463e6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:05.880708 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-acfbd478-d930-41f8-8c6a-030d802463e6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:05.881836 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-acfbd478-d930-41f8-8c6a-030d802463e6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.183963 May 17 17:11:05.882406 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 61/111] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:11:05 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:11:06.298522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7e909dc5-5510-4ca9-934b-31598d3d3249 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:06.300886 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7e909dc5-5510-4ca9-934b-31598d3d3249 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:06.309244 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e909dc5-5510-4ca9-934b-31598d3d3249 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:06.310004 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e909dc5-5510-4ca9-934b-31598d3d3249 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:06.311078 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e909dc5-5510-4ca9-934b-31598d3d3249 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:06.311793 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e909dc5-5510-4ca9-934b-31598d3d3249 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:06.326216 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e3bf3ebc-5577-4f1d-9504-fdda51318b54 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:06.327447 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-e3bf3ebc-5577-4f1d-9504-fdda51318b54 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:06.337549 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e3bf3ebc-5577-4f1d-9504-fdda51318b54 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:06.338672 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e3bf3ebc-5577-4f1d-9504-fdda51318b54 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:06.341047 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e3bf3ebc-5577-4f1d-9504-fdda51318b54 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:06.341974 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e3bf3ebc-5577-4f1d-9504-fdda51318b54 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:06.559251 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7e909dc5-5510-4ca9-934b-31598d3d3249 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:06.569728 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7e909dc5-5510-4ca9-934b-31598d3d3249 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.279073 May 17 17:11:06.570929 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 51/112] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:06 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:06.575935 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-c468e372-ceec-483d-9e58-e81e1d78cf2f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:06.576792 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-c468e372-ceec-483d-9e58-e81e1d78cf2f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:06.580163 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-e3bf3ebc-5577-4f1d-9504-fdda51318b54 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:06.585480 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c468e372-ceec-483d-9e58-e81e1d78cf2f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:06.585984 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c468e372-ceec-483d-9e58-e81e1d78cf2f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:06.587328 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c468e372-ceec-483d-9e58-e81e1d78cf2f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:06.587782 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c468e372-ceec-483d-9e58-e81e1d78cf2f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:06.589590 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e3bf3ebc-5577-4f1d-9504-fdda51318b54 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.266960 May 17 17:11:06.590255 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 62/113] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:06 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:06.735766 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-c468e372-ceec-483d-9e58-e81e1d78cf2f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:06.745113 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-c468e372-ceec-483d-9e58-e81e1d78cf2f tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1314 microversion: 2.1 time: 0.172817 May 17 17:11:06.745755 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 52/114] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:06 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:06.899005 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-42a2d828-f7e4-4457-96f9-c39129f96416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:06.899661 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-42a2d828-f7e4-4457-96f9-c39129f96416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:06.905518 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-42a2d828-f7e4-4457-96f9-c39129f96416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:06.905969 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-42a2d828-f7e4-4457-96f9-c39129f96416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:06.906731 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-42a2d828-f7e4-4457-96f9-c39129f96416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:06.907163 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-42a2d828-f7e4-4457-96f9-c39129f96416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:07.044218 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-42a2d828-f7e4-4457-96f9-c39129f96416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:07.053995 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-42a2d828-f7e4-4457-96f9-c39129f96416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:07.056827 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-42a2d828-f7e4-4457-96f9-c39129f96416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:07.058384 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-42a2d828-f7e4-4457-96f9-c39129f96416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.163148 May 17 17:11:07.059480 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 63/115] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:11:06 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:11:07.589843 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3cebe8df-4f47-44fc-897f-20669b1822d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:07.591447 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3cebe8df-4f47-44fc-897f-20669b1822d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:07.608787 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-544f1693-4462-4f69-bb44-6cf61949bc25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:07.610041 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-544f1693-4462-4f69-bb44-6cf61949bc25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:07.613012 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3cebe8df-4f47-44fc-897f-20669b1822d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:07.616793 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3cebe8df-4f47-44fc-897f-20669b1822d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:07.617589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-544f1693-4462-4f69-bb44-6cf61949bc25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:07.618941 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-544f1693-4462-4f69-bb44-6cf61949bc25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:07.620424 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-544f1693-4462-4f69-bb44-6cf61949bc25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:07.621016 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-544f1693-4462-4f69-bb44-6cf61949bc25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:07.626962 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3cebe8df-4f47-44fc-897f-20669b1822d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:07.627824 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3cebe8df-4f47-44fc-897f-20669b1822d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:07.904147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-544f1693-4462-4f69-bb44-6cf61949bc25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:07.909821 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-544f1693-4462-4f69-bb44-6cf61949bc25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.306436 May 17 17:11:07.913095 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 64/116] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:07 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:07.933347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-11bdd140-ef03-466a-af8e-3abbdf41427e req-75dad1b2-b6c5-4108-9b5e-0dee90b40bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee2bb8d5-d263-4ab1-8778-77fc4a30f388", "name": "network-vif-plugged", "status": "completed", "tag": "a1ea561d-09ff-4ccb-94e1-a73a746f4900"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:07.955632 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-11bdd140-ef03-466a-af8e-3abbdf41427e req-75dad1b2-b6c5-4108-9b5e-0dee90b40bdb service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:07.956183 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-11bdd140-ef03-466a-af8e-3abbdf41427e req-75dad1b2-b6c5-4108-9b5e-0dee90b40bdb service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:07.981801 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-11bdd140-ef03-466a-af8e-3abbdf41427e req-75dad1b2-b6c5-4108-9b5e-0dee90b40bdb service nova] Creating event network-vif-plugged:a1ea561d-09ff-4ccb-94e1-a73a746f4900 for instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 on hv-cinder-84214 May 17 17:11:07.992118 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-11bdd140-ef03-466a-af8e-3abbdf41427e req-75dad1b2-b6c5-4108-9b5e-0dee90b40bdb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065487 May 17 17:11:07.993086 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 65/117] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:11:08.002697 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3cebe8df-4f47-44fc-897f-20669b1822d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:08.005983 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-25b6cc95-2c43-4611-a5c2-4f5de95970d3 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:08.009089 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-25b6cc95-2c43-4611-a5c2-4f5de95970d3 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:08.012415 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3cebe8df-4f47-44fc-897f-20669b1822d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.428703 May 17 17:11:08.013673 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 53/118] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:07 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:08.021660 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-25b6cc95-2c43-4611-a5c2-4f5de95970d3 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:08.022110 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-25b6cc95-2c43-4611-a5c2-4f5de95970d3 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:08.025478 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-25b6cc95-2c43-4611-a5c2-4f5de95970d3 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:08.028693 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-25b6cc95-2c43-4611-a5c2-4f5de95970d3 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:08.077584 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d9c85632-db5e-4a86-b385-e146cbe0a65c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:08.078145 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d9c85632-db5e-4a86-b385-e146cbe0a65c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:08.097041 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d9c85632-db5e-4a86-b385-e146cbe0a65c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:08.115485 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d9c85632-db5e-4a86-b385-e146cbe0a65c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:08.117146 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d9c85632-db5e-4a86-b385-e146cbe0a65c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:08.128690 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d9c85632-db5e-4a86-b385-e146cbe0a65c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:08.332833 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-25b6cc95-2c43-4611-a5c2-4f5de95970d3 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:08.345539 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-25b6cc95-2c43-4611-a5c2-4f5de95970d3 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1501 microversion: 2.1 time: 0.350784 May 17 17:11:08.346281 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 66/119] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:07 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1501 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:08.389385 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d9c85632-db5e-4a86-b385-e146cbe0a65c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:08.399462 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d9c85632-db5e-4a86-b385-e146cbe0a65c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:08.401672 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d9c85632-db5e-4a86-b385-e146cbe0a65c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:08.403237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d9c85632-db5e-4a86-b385-e146cbe0a65c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.329570 May 17 17:11:08.403887 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 54/120] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:11:08 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:11:08.930437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f3fe7d35-5de6-4033-a55b-281ac9fbbbe4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:08.931150 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f3fe7d35-5de6-4033-a55b-281ac9fbbbe4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:08.937421 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3fe7d35-5de6-4033-a55b-281ac9fbbbe4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:08.937867 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3fe7d35-5de6-4033-a55b-281ac9fbbbe4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:08.938624 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3fe7d35-5de6-4033-a55b-281ac9fbbbe4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:08.939057 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3fe7d35-5de6-4033-a55b-281ac9fbbbe4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:09.029585 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-35121096-747d-498a-b690-bd5d55abe038 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:09.030744 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-35121096-747d-498a-b690-bd5d55abe038 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:09.036815 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-35121096-747d-498a-b690-bd5d55abe038 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:09.037568 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-35121096-747d-498a-b690-bd5d55abe038 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:09.039340 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-35121096-747d-498a-b690-bd5d55abe038 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:09.040226 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-35121096-747d-498a-b690-bd5d55abe038 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:09.123209 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f3fe7d35-5de6-4033-a55b-281ac9fbbbe4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:09.132152 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f3fe7d35-5de6-4033-a55b-281ac9fbbbe4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.205903 May 17 17:11:09.133570 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 67/121] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:08 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:09.221605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-35121096-747d-498a-b690-bd5d55abe038 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:09.230267 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-35121096-747d-498a-b690-bd5d55abe038 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.204468 May 17 17:11:09.231009 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 55/122] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:09 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:09.423290 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-972e3a7f-f0d5-47a1-95af-3f5339bdec50 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:09.423290 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-972e3a7f-f0d5-47a1-95af-3f5339bdec50 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:09.428292 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-972e3a7f-f0d5-47a1-95af-3f5339bdec50 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:09.428913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-972e3a7f-f0d5-47a1-95af-3f5339bdec50 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:09.430319 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-972e3a7f-f0d5-47a1-95af-3f5339bdec50 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:09.430754 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-972e3a7f-f0d5-47a1-95af-3f5339bdec50 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:09.581202 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-972e3a7f-f0d5-47a1-95af-3f5339bdec50 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:09.588977 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-972e3a7f-f0d5-47a1-95af-3f5339bdec50 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:09.590468 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-972e3a7f-f0d5-47a1-95af-3f5339bdec50 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:09.591774 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-972e3a7f-f0d5-47a1-95af-3f5339bdec50 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.174781 May 17 17:11:09.592686 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 68/123] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:11:09 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:11:10.150492 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ede05eee-d189-4d4c-9a29-d4adc5d82184 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:10.151931 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ede05eee-d189-4d4c-9a29-d4adc5d82184 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:10.157600 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ede05eee-d189-4d4c-9a29-d4adc5d82184 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:10.158247 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ede05eee-d189-4d4c-9a29-d4adc5d82184 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:10.159210 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ede05eee-d189-4d4c-9a29-d4adc5d82184 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:10.160052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ede05eee-d189-4d4c-9a29-d4adc5d82184 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:10.248057 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-85c8fa20-38bd-474d-bd05-fcf0b4fd221f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:10.248810 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-85c8fa20-38bd-474d-bd05-fcf0b4fd221f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:10.254843 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-85c8fa20-38bd-474d-bd05-fcf0b4fd221f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:10.255374 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-85c8fa20-38bd-474d-bd05-fcf0b4fd221f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:10.256408 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-85c8fa20-38bd-474d-bd05-fcf0b4fd221f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:10.257060 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-85c8fa20-38bd-474d-bd05-fcf0b4fd221f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:10.313299 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ede05eee-d189-4d4c-9a29-d4adc5d82184 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:10.322815 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ede05eee-d189-4d4c-9a29-d4adc5d82184 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.176612 May 17 17:11:10.330017 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 56/124] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:10 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:10.443342 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-85c8fa20-38bd-474d-bd05-fcf0b4fd221f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:10.451198 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-85c8fa20-38bd-474d-bd05-fcf0b4fd221f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.206839 May 17 17:11:10.461889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 69/125] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:10 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:10.609854 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ceb5b969-9f53-4918-a4d4-690d2e424b97 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:10.610061 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ceb5b969-9f53-4918-a4d4-690d2e424b97 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:10.618134 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ceb5b969-9f53-4918-a4d4-690d2e424b97 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:10.618933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ceb5b969-9f53-4918-a4d4-690d2e424b97 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:10.619814 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ceb5b969-9f53-4918-a4d4-690d2e424b97 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:10.620270 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ceb5b969-9f53-4918-a4d4-690d2e424b97 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:10.766162 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ceb5b969-9f53-4918-a4d4-690d2e424b97 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:10.775172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ceb5b969-9f53-4918-a4d4-690d2e424b97 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:10.776730 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ceb5b969-9f53-4918-a4d4-690d2e424b97 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:10.778099 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ceb5b969-9f53-4918-a4d4-690d2e424b97 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.172622 May 17 17:11:10.778848 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 57/126] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:11:10 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:11:11.341092 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-291728de-ccd5-4eb9-995c-64507b4d4ee7 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:11.341886 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-291728de-ccd5-4eb9-995c-64507b4d4ee7 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:11.348377 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-291728de-ccd5-4eb9-995c-64507b4d4ee7 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:11.348861 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-291728de-ccd5-4eb9-995c-64507b4d4ee7 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:11.349890 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-291728de-ccd5-4eb9-995c-64507b4d4ee7 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:11.350610 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-291728de-ccd5-4eb9-995c-64507b4d4ee7 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:11.469596 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-275baee1-c467-41d5-a5ac-01630274f833 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:11.470217 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-275baee1-c467-41d5-a5ac-01630274f833 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:11.477024 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-275baee1-c467-41d5-a5ac-01630274f833 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:11.478073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-275baee1-c467-41d5-a5ac-01630274f833 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:11.480351 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-275baee1-c467-41d5-a5ac-01630274f833 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:11.481187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-275baee1-c467-41d5-a5ac-01630274f833 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:11.592013 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-291728de-ccd5-4eb9-995c-64507b4d4ee7 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:11.605964 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-291728de-ccd5-4eb9-995c-64507b4d4ee7 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1361 microversion: 2.1 time: 0.269178 May 17 17:11:11.607287 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 70/127] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:11 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:11.708659 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-275baee1-c467-41d5-a5ac-01630274f833 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:11.718170 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-275baee1-c467-41d5-a5ac-01630274f833 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.253458 May 17 17:11:11.718877 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 58/128] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:11 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:11.805442 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1bc1f3ac-2af6-491c-ae27-7ee8ebe41685 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:11.806254 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1bc1f3ac-2af6-491c-ae27-7ee8ebe41685 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:11.813506 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1bc1f3ac-2af6-491c-ae27-7ee8ebe41685 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:11.814043 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1bc1f3ac-2af6-491c-ae27-7ee8ebe41685 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:11.815194 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1bc1f3ac-2af6-491c-ae27-7ee8ebe41685 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:11.815995 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1bc1f3ac-2af6-491c-ae27-7ee8ebe41685 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:11.972857 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-5da9e078-a2c0-4d67-9299-15d2fcdf9029 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bbf349c-a47c-429f-9636-1438c55928be"}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:11.974059 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-5da9e078-a2c0-4d67-9299-15d2fcdf9029 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:11.990705 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5da9e078-a2c0-4d67-9299-15d2fcdf9029 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:11.991169 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5da9e078-a2c0-4d67-9299-15d2fcdf9029 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:11.992488 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5da9e078-a2c0-4d67-9299-15d2fcdf9029 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:11.993374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5da9e078-a2c0-4d67-9299-15d2fcdf9029 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:11.993714 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1bc1f3ac-2af6-491c-ae27-7ee8ebe41685 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:12.003020 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1bc1f3ac-2af6-491c-ae27-7ee8ebe41685 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:12.004567 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1bc1f3ac-2af6-491c-ae27-7ee8ebe41685 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:12.006006 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1bc1f3ac-2af6-491c-ae27-7ee8ebe41685 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.205717 May 17 17:11:12.006854 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 71/129] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:11:11 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:11:12.520635 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-5da9e078-a2c0-4d67-9299-15d2fcdf9029 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "POST /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535847 May 17 17:11:12.524298 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 59/130] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 17 17:11:11 2022] POST /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b/os-volume_attachments => generated 194 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:11:12.607715 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-508f02f0-0232-499b-aaa7-396dd8ca814c req-0b2e6e38-2335-487d-9bf0-e719eb6d4045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e0001f-f7bc-4b5c-8083-c72723f1d8d4", "name": "network-vif-plugged", "status": "completed", "tag": "1efef679-0e58-4dd9-94e3-c4f323122713"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:12.625581 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f58a1f52-7579-44fd-86f3-01ba1603a029 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:12.626367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f58a1f52-7579-44fd-86f3-01ba1603a029 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:12.643416 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-508f02f0-0232-499b-aaa7-396dd8ca814c req-0b2e6e38-2335-487d-9bf0-e719eb6d4045 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:12.644000 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-508f02f0-0232-499b-aaa7-396dd8ca814c req-0b2e6e38-2335-487d-9bf0-e719eb6d4045 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:12.647412 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f58a1f52-7579-44fd-86f3-01ba1603a029 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:12.648520 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f58a1f52-7579-44fd-86f3-01ba1603a029 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:12.656137 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f58a1f52-7579-44fd-86f3-01ba1603a029 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:12.656522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f58a1f52-7579-44fd-86f3-01ba1603a029 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:12.678361 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-508f02f0-0232-499b-aaa7-396dd8ca814c req-0b2e6e38-2335-487d-9bf0-e719eb6d4045 service nova] Creating event network-vif-plugged:1efef679-0e58-4dd9-94e3-c4f323122713 for instance 58e0001f-f7bc-4b5c-8083-c72723f1d8d4 on hv-cinder-84214 May 17 17:11:12.700075 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-508f02f0-0232-499b-aaa7-396dd8ca814c req-0b2e6e38-2335-487d-9bf0-e719eb6d4045 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090057 May 17 17:11:12.703280 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 72/131] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:11:12.736096 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-eb29354f-97ae-43fb-be11-7d709efe2e4f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:12.737925 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-eb29354f-97ae-43fb-be11-7d709efe2e4f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:12.751530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-eb29354f-97ae-43fb-be11-7d709efe2e4f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:12.752033 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-eb29354f-97ae-43fb-be11-7d709efe2e4f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:12.752836 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-eb29354f-97ae-43fb-be11-7d709efe2e4f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:12.757502 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-eb29354f-97ae-43fb-be11-7d709efe2e4f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:12.934436 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f58a1f52-7579-44fd-86f3-01ba1603a029 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:12.944397 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f58a1f52-7579-44fd-86f3-01ba1603a029 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1548 microversion: 2.1 time: 0.323749 May 17 17:11:12.945607 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 60/132] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:12 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1548 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:12.970356 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4c3566bf-7e16-427b-af22-d181529cebbb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:12.973402 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4c3566bf-7e16-427b-af22-d181529cebbb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:12.983246 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c3566bf-7e16-427b-af22-d181529cebbb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:12.985303 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c3566bf-7e16-427b-af22-d181529cebbb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:12.986329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c3566bf-7e16-427b-af22-d181529cebbb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:12.989319 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c3566bf-7e16-427b-af22-d181529cebbb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:13.088338 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-eb29354f-97ae-43fb-be11-7d709efe2e4f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:13.103378 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-eb29354f-97ae-43fb-be11-7d709efe2e4f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.372750 May 17 17:11:13.112742 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 73/133] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:12 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:13.116093 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4c3566bf-7e16-427b-af22-d181529cebbb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157665 May 17 17:11:13.116705 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 61/134] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 17 17:11:12 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:11:13.125239 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-59a6efde-a6c7-4a52-858e-24a11633f333 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:13.125821 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-59a6efde-a6c7-4a52-858e-24a11633f333 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:13.140820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-59a6efde-a6c7-4a52-858e-24a11633f333 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:13.141530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-59a6efde-a6c7-4a52-858e-24a11633f333 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:13.142469 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-59a6efde-a6c7-4a52-858e-24a11633f333 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:13.142903 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-59a6efde-a6c7-4a52-858e-24a11633f333 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:13.641163 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-59a6efde-a6c7-4a52-858e-24a11633f333 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:13.657698 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-59a6efde-a6c7-4a52-858e-24a11633f333 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:13.659255 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-59a6efde-a6c7-4a52-858e-24a11633f333 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:13.660397 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-59a6efde-a6c7-4a52-858e-24a11633f333 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.546506 May 17 17:11:13.661107 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 74/135] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:11:13 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:11:14.122836 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9d4f7e5c-171a-42d5-add2-a5bd752834c4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:14.124054 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9d4f7e5c-171a-42d5-add2-a5bd752834c4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:14.137973 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9d4f7e5c-171a-42d5-add2-a5bd752834c4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:14.138464 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9d4f7e5c-171a-42d5-add2-a5bd752834c4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:14.139259 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9d4f7e5c-171a-42d5-add2-a5bd752834c4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:14.139738 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9d4f7e5c-171a-42d5-add2-a5bd752834c4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:14.401051 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9d4f7e5c-171a-42d5-add2-a5bd752834c4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:14.419156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9d4f7e5c-171a-42d5-add2-a5bd752834c4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1322 microversion: 2.1 time: 0.302600 May 17 17:11:14.421309 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 62/136] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:14 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:14.680474 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ed532e72-0055-463a-8754-82badab256f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:14.681095 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ed532e72-0055-463a-8754-82badab256f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:14.693628 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ed532e72-0055-463a-8754-82badab256f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:14.696825 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ed532e72-0055-463a-8754-82badab256f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:14.698250 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ed532e72-0055-463a-8754-82badab256f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:14.701559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ed532e72-0055-463a-8754-82badab256f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:14.760452 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-40f23f2a-0b86-4156-9206-c6ed280342ba req-8da7e18b-0a77-4974-a065-a48cbdef01de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b074c961-149b-4667-addc-790568769b88", "name": "network-vif-plugged", "status": "completed", "tag": "e6735ae1-4241-48ca-9802-22aba7b4cccc"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:14.780830 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-40f23f2a-0b86-4156-9206-c6ed280342ba req-8da7e18b-0a77-4974-a065-a48cbdef01de service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:14.782952 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-40f23f2a-0b86-4156-9206-c6ed280342ba req-8da7e18b-0a77-4974-a065-a48cbdef01de service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:14.810205 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-40f23f2a-0b86-4156-9206-c6ed280342ba req-8da7e18b-0a77-4974-a065-a48cbdef01de service nova] Creating event network-vif-plugged:e6735ae1-4241-48ca-9802-22aba7b4cccc for instance b074c961-149b-4667-addc-790568769b88 on hv-cinder-84214 May 17 17:11:14.821765 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-40f23f2a-0b86-4156-9206-c6ed280342ba req-8da7e18b-0a77-4974-a065-a48cbdef01de service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065279 May 17 17:11:14.825316 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 63/137] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:11:15.325191 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ed532e72-0055-463a-8754-82badab256f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:15.334136 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ed532e72-0055-463a-8754-82badab256f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:15.345275 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ed532e72-0055-463a-8754-82badab256f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:15.346385 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-20821c94-55bf-418a-9a14-763ea840a88b req-9a5516fc-b2d1-42a7-8e3e-0834b67300ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee2bb8d5-d263-4ab1-8778-77fc4a30f388", "tag": "a1ea561d-09ff-4ccb-94e1-a73a746f4900"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:15.347515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ed532e72-0055-463a-8754-82badab256f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.672317 May 17 17:11:15.348627 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 75/138] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:11:14 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:11:15.361880 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-20821c94-55bf-418a-9a14-763ea840a88b req-9a5516fc-b2d1-42a7-8e3e-0834b67300ce service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:15.362540 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-20821c94-55bf-418a-9a14-763ea840a88b req-9a5516fc-b2d1-42a7-8e3e-0834b67300ce service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:15.383123 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-20821c94-55bf-418a-9a14-763ea840a88b req-9a5516fc-b2d1-42a7-8e3e-0834b67300ce service nova] Creating event network-changed:a1ea561d-09ff-4ccb-94e1-a73a746f4900 for instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 on hv-cinder-84214 May 17 17:11:15.391885 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-20821c94-55bf-418a-9a14-763ea840a88b req-9a5516fc-b2d1-42a7-8e3e-0834b67300ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049633 May 17 17:11:15.392897 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 64/139] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:11:15.439177 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8fd52c66-c5b7-4507-b810-69924bc994d4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:15.441897 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8fd52c66-c5b7-4507-b810-69924bc994d4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:15.454828 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8fd52c66-c5b7-4507-b810-69924bc994d4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:15.455979 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8fd52c66-c5b7-4507-b810-69924bc994d4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:15.457998 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8fd52c66-c5b7-4507-b810-69924bc994d4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:15.458764 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8fd52c66-c5b7-4507-b810-69924bc994d4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:15.710786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8fd52c66-c5b7-4507-b810-69924bc994d4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:15.725370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8fd52c66-c5b7-4507-b810-69924bc994d4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1516 microversion: 2.1 time: 0.290612 May 17 17:11:15.727161 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 76/140] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:15 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1516 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:15.755271 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-52d7eb04-effe-43f5-a614-6f53c87cbe91 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:15.755271 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-52d7eb04-effe-43f5-a614-6f53c87cbe91 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:15.758749 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-52d7eb04-effe-43f5-a614-6f53c87cbe91 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:15.765134 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-52d7eb04-effe-43f5-a614-6f53c87cbe91 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:15.766094 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-52d7eb04-effe-43f5-a614-6f53c87cbe91 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:15.766671 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-52d7eb04-effe-43f5-a614-6f53c87cbe91 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:15.810431 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-52d7eb04-effe-43f5-a614-6f53c87cbe91 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lazy-loading 'flavor' on Instance uuid 58e0001f-f7bc-4b5c-8083-c72723f1d8d4 {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:11:15.995634 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-52d7eb04-effe-43f5-a614-6f53c87cbe91 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "POST /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4/action" status: 200 len: 32 microversion: 2.1 time: 0.251969 May 17 17:11:16.000319 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 65/141] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 17 17:11:15 2022] POST /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4/action => generated 32 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 17:11:16.005462 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3196fbce-94dd-45c0-b9e2-05f13f1575ac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:16.006105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-3196fbce-94dd-45c0-b9e2-05f13f1575ac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:16.015995 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3196fbce-94dd-45c0-b9e2-05f13f1575ac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:16.016500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3196fbce-94dd-45c0-b9e2-05f13f1575ac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:16.017317 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3196fbce-94dd-45c0-b9e2-05f13f1575ac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:16.017762 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3196fbce-94dd-45c0-b9e2-05f13f1575ac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:16.181398 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-3196fbce-94dd-45c0-b9e2-05f13f1575ac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:16.190868 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-3196fbce-94dd-45c0-b9e2-05f13f1575ac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.189023 May 17 17:11:16.191877 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 77/142] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:16 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:16.374970 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-df05d94f-a205-40bf-b1f2-98f1df73bd7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:16.377069 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-df05d94f-a205-40bf-b1f2-98f1df73bd7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:16.398231 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df05d94f-a205-40bf-b1f2-98f1df73bd7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:16.399004 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df05d94f-a205-40bf-b1f2-98f1df73bd7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:16.399963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df05d94f-a205-40bf-b1f2-98f1df73bd7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:16.400824 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df05d94f-a205-40bf-b1f2-98f1df73bd7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:16.685177 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-df05d94f-a205-40bf-b1f2-98f1df73bd7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:16.698946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-df05d94f-a205-40bf-b1f2-98f1df73bd7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:16.700636 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-df05d94f-a205-40bf-b1f2-98f1df73bd7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:16.702858 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-df05d94f-a205-40bf-b1f2-98f1df73bd7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1408 microversion: 2.20 time: 0.338081 May 17 17:11:16.704578 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 66/143] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:11:16 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1408 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:11:17.208336 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5260cce1-d4f6-4172-8208-828724038416 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:17.209586 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5260cce1-d4f6-4172-8208-828724038416 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:17.216676 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5260cce1-d4f6-4172-8208-828724038416 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:17.217404 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5260cce1-d4f6-4172-8208-828724038416 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:17.218430 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5260cce1-d4f6-4172-8208-828724038416 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:17.218931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5260cce1-d4f6-4172-8208-828724038416 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:17.514958 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5260cce1-d4f6-4172-8208-828724038416 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:17.523842 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5260cce1-d4f6-4172-8208-828724038416 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.319373 May 17 17:11:17.526515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 78/144] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:17 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:17.722507 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ffc44eaa-9d1a-408c-9215-2219aed1f1c8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:17.723105 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ffc44eaa-9d1a-408c-9215-2219aed1f1c8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:17.734960 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ffc44eaa-9d1a-408c-9215-2219aed1f1c8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:17.735515 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ffc44eaa-9d1a-408c-9215-2219aed1f1c8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:17.736244 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ffc44eaa-9d1a-408c-9215-2219aed1f1c8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:17.736705 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ffc44eaa-9d1a-408c-9215-2219aed1f1c8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:17.930293 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ffc44eaa-9d1a-408c-9215-2219aed1f1c8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:17.938373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ffc44eaa-9d1a-408c-9215-2219aed1f1c8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:17.940721 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ffc44eaa-9d1a-408c-9215-2219aed1f1c8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:17.942365 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ffc44eaa-9d1a-408c-9215-2219aed1f1c8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1600 microversion: 2.20 time: 0.223888 May 17 17:11:17.943066 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 67/145] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:11:17 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1600 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:11:17.969459 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-89a6f279-9fd8-40ce-a137-3d0fbcd66cf1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:17.970300 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-89a6f279-9fd8-40ce-a137-3d0fbcd66cf1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:17.980610 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-89a6f279-9fd8-40ce-a137-3d0fbcd66cf1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:17.981382 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-89a6f279-9fd8-40ce-a137-3d0fbcd66cf1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:17.982654 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-89a6f279-9fd8-40ce-a137-3d0fbcd66cf1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:17.984204 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-89a6f279-9fd8-40ce-a137-3d0fbcd66cf1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:18.166894 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-89a6f279-9fd8-40ce-a137-3d0fbcd66cf1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.203589 May 17 17:11:18.167713 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 79/146] 10.222.0.48 () {60 vars in 1315 bytes} [Tue May 17 17:11:17 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:11:18.543576 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b11c2707-4dfb-4645-b362-f336d4bff012 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:18.544212 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-b11c2707-4dfb-4645-b362-f336d4bff012 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:18.551801 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b11c2707-4dfb-4645-b362-f336d4bff012 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:18.552503 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b11c2707-4dfb-4645-b362-f336d4bff012 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:18.553435 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b11c2707-4dfb-4645-b362-f336d4bff012 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:18.554790 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b11c2707-4dfb-4645-b362-f336d4bff012 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:18.849873 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-b11c2707-4dfb-4645-b362-f336d4bff012 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:18.886263 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-b11c2707-4dfb-4645-b362-f336d4bff012 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.347354 May 17 17:11:18.887151 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 68/147] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:18 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:19.640688 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-80a3c401-7a8d-442c-a186-b922070634cd req-811ad969-c792-4024-8ff8-36f47a1172e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b074c961-149b-4667-addc-790568769b88", "tag": "e6735ae1-4241-48ca-9802-22aba7b4cccc"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:19.650137 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-80a3c401-7a8d-442c-a186-b922070634cd req-811ad969-c792-4024-8ff8-36f47a1172e0 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:19.650571 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-80a3c401-7a8d-442c-a186-b922070634cd req-811ad969-c792-4024-8ff8-36f47a1172e0 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:19.664807 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-80a3c401-7a8d-442c-a186-b922070634cd req-811ad969-c792-4024-8ff8-36f47a1172e0 service nova] Creating event network-changed:e6735ae1-4241-48ca-9802-22aba7b4cccc for instance b074c961-149b-4667-addc-790568769b88 on hv-cinder-84214 May 17 17:11:19.671015 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-80a3c401-7a8d-442c-a186-b922070634cd req-811ad969-c792-4024-8ff8-36f47a1172e0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034769 May 17 17:11:19.675762 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 80/148] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:11:19.904427 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-01b03c05-d42c-4d34-8444-5758b9c79b80 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:19.905130 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-01b03c05-d42c-4d34-8444-5758b9c79b80 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:19.913005 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-01b03c05-d42c-4d34-8444-5758b9c79b80 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:19.914023 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-01b03c05-d42c-4d34-8444-5758b9c79b80 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:19.915005 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-01b03c05-d42c-4d34-8444-5758b9c79b80 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:19.915651 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-01b03c05-d42c-4d34-8444-5758b9c79b80 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:20.212543 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-01b03c05-d42c-4d34-8444-5758b9c79b80 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:20.224530 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-01b03c05-d42c-4d34-8444-5758b9c79b80 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.323397 May 17 17:11:20.226040 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 69/149] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:19 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:21.244996 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8c905a46-13e6-49d8-baa8-af3f1451b5eb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:21.245711 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8c905a46-13e6-49d8-baa8-af3f1451b5eb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:21.251845 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8c905a46-13e6-49d8-baa8-af3f1451b5eb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:21.252294 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8c905a46-13e6-49d8-baa8-af3f1451b5eb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:21.253069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8c905a46-13e6-49d8-baa8-af3f1451b5eb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:21.253523 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8c905a46-13e6-49d8-baa8-af3f1451b5eb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:21.458208 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8c905a46-13e6-49d8-baa8-af3f1451b5eb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:21.469811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8c905a46-13e6-49d8-baa8-af3f1451b5eb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.229322 May 17 17:11:21.472367 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 81/150] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:21 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:22.378361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1166239653", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "networks": [{"uuid": "70c87c86-2820-494f-92b7-3ef8c78c46f3"}]}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:22.438780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] validate_networks() for [('70c87c86-2820-494f-92b7-3ef8c78c46f3', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:11:22.486090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-717406cd-6f2f-4bf4-91c1-928805718875 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:22.486652 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-717406cd-6f2f-4bf4-91c1-928805718875 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:22.493366 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-717406cd-6f2f-4bf4-91c1-928805718875 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:22.493808 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-717406cd-6f2f-4bf4-91c1-928805718875 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:22.494854 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-717406cd-6f2f-4bf4-91c1-928805718875 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:22.495294 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-717406cd-6f2f-4bf4-91c1-928805718875 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:22.527240 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-717406cd-6f2f-4bf4-91c1-928805718875 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Going to try to terminate instance {{(pid=117090) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:11:22.636072 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-717406cd-6f2f-4bf4-91c1-928805718875 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 204 len: 0 microversion: 2.1 time: 0.153247 May 17 17:11:22.641857 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 82/151] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:11:22 2022] DELETE /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 17:11:22.648018 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b86095ca-a892-4b48-b98b-e0fe8c9d5d5a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:22.649403 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b86095ca-a892-4b48-b98b-e0fe8c9d5d5a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:22.657930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b86095ca-a892-4b48-b98b-e0fe8c9d5d5a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:22.658486 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b86095ca-a892-4b48-b98b-e0fe8c9d5d5a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:22.660084 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b86095ca-a892-4b48-b98b-e0fe8c9d5d5a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:22.661277 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b86095ca-a892-4b48-b98b-e0fe8c9d5d5a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:22.935534 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b86095ca-a892-4b48-b98b-e0fe8c9d5d5a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:22.946589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b86095ca-a892-4b48-b98b-e0fe8c9d5d5a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.307642 May 17 17:11:22.956689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 83/152] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:22 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:22.959177 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:11:22.960544 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:11:22.961331 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:11:22.962014 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:11:22.962413 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8f5c7e9c-c53d-4530-9ad6-fdc6ead77feb tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:22.962673 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:11:22.963403 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8f5c7e9c-c53d-4530-9ad6-fdc6ead77feb tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:22.970808 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8f5c7e9c-c53d-4530-9ad6-fdc6ead77feb tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:22.971311 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8f5c7e9c-c53d-4530-9ad6-fdc6ead77feb tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:22.972173 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8f5c7e9c-c53d-4530-9ad6-fdc6ead77feb tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:22.972826 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8f5c7e9c-c53d-4530-9ad6-fdc6ead77feb tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:22.981802 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:22.982253 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:22.983059 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:22.983498 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:23.008918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Getting quotas for project b5858756d2b74673a765c1d2e6adf280. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:11:23.013624 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Getting quotas for user c3feefbd066d49148171c392838b4e15 and project b5858756d2b74673a765c1d2e6adf280. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:11:23.027395 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:11:23.030075 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:11:23.083283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-b6f1faa5-fb15-4773-9b96-fb490319150a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709111 May 17 17:11:23.097697 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 70/153] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:11:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:11:23.103856 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-93325615-4b1a-4787-bc02-bc3f2bac0aec tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:23.104488 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-93325615-4b1a-4787-bc02-bc3f2bac0aec tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:23.417485 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-93325615-4b1a-4787-bc02-bc3f2bac0aec tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:23.430754 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-93325615-4b1a-4787-bc02-bc3f2bac0aec tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1214 microversion: 2.1 time: 0.332236 May 17 17:11:23.431345 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 71/154] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:23 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1214 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:23.524412 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8f5c7e9c-c53d-4530-9ad6-fdc6ead77feb tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:23.546661 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8f5c7e9c-c53d-4530-9ad6-fdc6ead77feb tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1553 microversion: 2.1 time: 0.587229 May 17 17:11:23.547460 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 84/155] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:22 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1553 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:23.963919 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-40a4884c-9d0b-4018-af61-8bfcf3b089a5 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:23.964460 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-40a4884c-9d0b-4018-af61-8bfcf3b089a5 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:23.974067 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-40a4884c-9d0b-4018-af61-8bfcf3b089a5 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:23.974525 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-40a4884c-9d0b-4018-af61-8bfcf3b089a5 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:23.975351 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-40a4884c-9d0b-4018-af61-8bfcf3b089a5 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:23.975824 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-40a4884c-9d0b-4018-af61-8bfcf3b089a5 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:24.133786 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-40a4884c-9d0b-4018-af61-8bfcf3b089a5 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:24.141398 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-40a4884c-9d0b-4018-af61-8bfcf3b089a5 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.181823 May 17 17:11:24.141971 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 72/156] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:23 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:24.447318 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f73b2e04-eb9a-4fac-8aa2-8bca85cde896 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:24.447963 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f73b2e04-eb9a-4fac-8aa2-8bca85cde896 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:24.453761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f73b2e04-eb9a-4fac-8aa2-8bca85cde896 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:24.454209 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f73b2e04-eb9a-4fac-8aa2-8bca85cde896 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:24.454971 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f73b2e04-eb9a-4fac-8aa2-8bca85cde896 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:24.455406 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f73b2e04-eb9a-4fac-8aa2-8bca85cde896 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:24.514700 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f73b2e04-eb9a-4fac-8aa2-8bca85cde896 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:24.524034 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f73b2e04-eb9a-4fac-8aa2-8bca85cde896 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1218 microversion: 2.1 time: 0.080393 May 17 17:11:24.524608 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 85/157] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:24 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:24.565619 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-85d6a9cf-c89c-499d-832c-af2512ad0103 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:24.566524 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-85d6a9cf-c89c-499d-832c-af2512ad0103 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:24.573311 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-85d6a9cf-c89c-499d-832c-af2512ad0103 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:24.573848 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-85d6a9cf-c89c-499d-832c-af2512ad0103 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:24.574604 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-85d6a9cf-c89c-499d-832c-af2512ad0103 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:24.575043 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-85d6a9cf-c89c-499d-832c-af2512ad0103 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:24.721667 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-85d6a9cf-c89c-499d-832c-af2512ad0103 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:24.730718 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-85d6a9cf-c89c-499d-832c-af2512ad0103 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1553 microversion: 2.1 time: 0.168954 May 17 17:11:24.731291 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 73/158] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:24 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:25.158292 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-06c20794-675e-4316-b10e-5f28df06f25e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:25.158908 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-06c20794-675e-4316-b10e-5f28df06f25e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:25.165871 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-06c20794-675e-4316-b10e-5f28df06f25e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:25.166315 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-06c20794-675e-4316-b10e-5f28df06f25e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:25.167080 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-06c20794-675e-4316-b10e-5f28df06f25e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:25.167512 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-06c20794-675e-4316-b10e-5f28df06f25e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:25.300311 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-06c20794-675e-4316-b10e-5f28df06f25e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:25.309328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-06c20794-675e-4316-b10e-5f28df06f25e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.154924 May 17 17:11:25.309910 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 86/159] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:25 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:25.541491 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ecedd083-9282-44fa-ba57-ead96987465a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:25.542125 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ecedd083-9282-44fa-ba57-ead96987465a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:25.548139 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ecedd083-9282-44fa-ba57-ead96987465a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:25.548591 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ecedd083-9282-44fa-ba57-ead96987465a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:25.549363 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ecedd083-9282-44fa-ba57-ead96987465a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:25.549799 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ecedd083-9282-44fa-ba57-ead96987465a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:25.612936 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ecedd083-9282-44fa-ba57-ead96987465a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:25.620958 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ecedd083-9282-44fa-ba57-ead96987465a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1218 microversion: 2.1 time: 0.084267 May 17 17:11:25.621836 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 74/160] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:25 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:25.747965 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5ad95bd3-f6e8-4587-acab-09f6184fabc2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:25.748575 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5ad95bd3-f6e8-4587-acab-09f6184fabc2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:25.754292 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5ad95bd3-f6e8-4587-acab-09f6184fabc2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:25.754746 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5ad95bd3-f6e8-4587-acab-09f6184fabc2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:25.755500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5ad95bd3-f6e8-4587-acab-09f6184fabc2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:25.755956 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5ad95bd3-f6e8-4587-acab-09f6184fabc2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:25.895689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5ad95bd3-f6e8-4587-acab-09f6184fabc2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:25.903968 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5ad95bd3-f6e8-4587-acab-09f6184fabc2 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1553 microversion: 2.1 time: 0.159668 May 17 17:11:25.904524 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 87/161] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:25 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:26.327078 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2c5e1a59-2027-4c33-adee-9b778aa9bca8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:26.327803 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2c5e1a59-2027-4c33-adee-9b778aa9bca8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:26.335019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2c5e1a59-2027-4c33-adee-9b778aa9bca8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:26.335540 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2c5e1a59-2027-4c33-adee-9b778aa9bca8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:26.336452 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2c5e1a59-2027-4c33-adee-9b778aa9bca8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:26.336987 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2c5e1a59-2027-4c33-adee-9b778aa9bca8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:26.492865 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2c5e1a59-2027-4c33-adee-9b778aa9bca8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:26.500347 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2c5e1a59-2027-4c33-adee-9b778aa9bca8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.177906 May 17 17:11:26.500910 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 75/162] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:26 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:26.637170 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ffcac9e6-d132-4375-ac1f-710ccac6b0d5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:26.637775 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ffcac9e6-d132-4375-ac1f-710ccac6b0d5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:26.644298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ffcac9e6-d132-4375-ac1f-710ccac6b0d5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:26.644824 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ffcac9e6-d132-4375-ac1f-710ccac6b0d5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:26.645776 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ffcac9e6-d132-4375-ac1f-710ccac6b0d5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:26.646204 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ffcac9e6-d132-4375-ac1f-710ccac6b0d5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:26.711194 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ffcac9e6-d132-4375-ac1f-710ccac6b0d5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:26.719449 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ffcac9e6-d132-4375-ac1f-710ccac6b0d5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1266 microversion: 2.1 time: 0.086465 May 17 17:11:26.720176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 88/163] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:26 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:26.922030 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-070ef2c2-0511-4fb9-ba55-c2433db075f5 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:26.922548 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-070ef2c2-0511-4fb9-ba55-c2433db075f5 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:26.929149 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-070ef2c2-0511-4fb9-ba55-c2433db075f5 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:26.929462 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-070ef2c2-0511-4fb9-ba55-c2433db075f5 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:26.930249 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-070ef2c2-0511-4fb9-ba55-c2433db075f5 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:26.930686 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-070ef2c2-0511-4fb9-ba55-c2433db075f5 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:27.212310 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-070ef2c2-0511-4fb9-ba55-c2433db075f5 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:27.220306 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-070ef2c2-0511-4fb9-ba55-c2433db075f5 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1553 microversion: 2.1 time: 0.302284 May 17 17:11:27.220892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 76/164] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:26 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1553 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:27.520666 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d08d854c-a8b3-40f6-bd18-18600bbc31be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:27.521383 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d08d854c-a8b3-40f6-bd18-18600bbc31be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:27.530026 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d08d854c-a8b3-40f6-bd18-18600bbc31be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:27.530564 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d08d854c-a8b3-40f6-bd18-18600bbc31be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:27.531500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d08d854c-a8b3-40f6-bd18-18600bbc31be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:27.532066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d08d854c-a8b3-40f6-bd18-18600bbc31be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:27.698291 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d08d854c-a8b3-40f6-bd18-18600bbc31be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:27.705968 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d08d854c-a8b3-40f6-bd18-18600bbc31be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.192162 May 17 17:11:27.706532 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 89/165] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:27 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:27.737391 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7c31fb7f-7daa-40be-84db-107e768199e6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:27.738418 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7c31fb7f-7daa-40be-84db-107e768199e6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:27.745734 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7c31fb7f-7daa-40be-84db-107e768199e6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:27.746504 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7c31fb7f-7daa-40be-84db-107e768199e6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:27.747963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7c31fb7f-7daa-40be-84db-107e768199e6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:27.748670 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7c31fb7f-7daa-40be-84db-107e768199e6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:27.830973 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7c31fb7f-7daa-40be-84db-107e768199e6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:27.843469 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7c31fb7f-7daa-40be-84db-107e768199e6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1272 microversion: 2.1 time: 0.109898 May 17 17:11:27.844463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 77/166] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:27 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:28.237488 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5930ab4f-6f5e-4c58-a6d4-46443dbf33db tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:28.238422 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5930ab4f-6f5e-4c58-a6d4-46443dbf33db tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:28.251053 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5930ab4f-6f5e-4c58-a6d4-46443dbf33db tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:28.251698 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5930ab4f-6f5e-4c58-a6d4-46443dbf33db tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:28.252629 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5930ab4f-6f5e-4c58-a6d4-46443dbf33db tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:28.253209 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5930ab4f-6f5e-4c58-a6d4-46443dbf33db tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:28.337732 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5930ab4f-6f5e-4c58-a6d4-46443dbf33db tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:28.346990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5930ab4f-6f5e-4c58-a6d4-46443dbf33db tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1511 microversion: 2.1 time: 0.112681 May 17 17:11:28.356365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 90/167] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:28 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1511 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:28.427411 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-2f78bee1-d808-4e92-9770-d8fb5060e5c9 req-8f5e8966-6668-4d82-9935-1726c286f1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8fba30-1d0b-43ea-ad0c-11129104e39b", "name": "network-vif-deleted", "tag": "43c4a27e-6ab5-4983-a112-df5a98db82e8"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:28.436973 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-2f78bee1-d808-4e92-9770-d8fb5060e5c9 req-8f5e8966-6668-4d82-9935-1726c286f1e9 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:28.437457 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-2f78bee1-d808-4e92-9770-d8fb5060e5c9 req-8f5e8966-6668-4d82-9935-1726c286f1e9 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:28.468528 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-2f78bee1-d808-4e92-9770-d8fb5060e5c9 req-8f5e8966-6668-4d82-9935-1726c286f1e9 service nova] Creating event network-vif-deleted:43c4a27e-6ab5-4983-a112-df5a98db82e8 for instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b on hv-cinder-84214 May 17 17:11:28.476184 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-2f78bee1-d808-4e92-9770-d8fb5060e5c9 req-8f5e8966-6668-4d82-9935-1726c286f1e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051165 May 17 17:11:28.477070 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 78/168] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:11:28.724014 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-73ec067c-3613-4b74-954c-b4a9903ba076 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:28.725235 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-73ec067c-3613-4b74-954c-b4a9903ba076 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:28.732419 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-73ec067c-3613-4b74-954c-b4a9903ba076 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:28.732883 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-73ec067c-3613-4b74-954c-b4a9903ba076 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:28.733648 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-73ec067c-3613-4b74-954c-b4a9903ba076 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:28.734079 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-73ec067c-3613-4b74-954c-b4a9903ba076 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:28.864094 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-638a666c-8172-498c-819d-1e4d853690ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:28.866559 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-638a666c-8172-498c-819d-1e4d853690ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:28.875489 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-638a666c-8172-498c-819d-1e4d853690ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:28.876364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-638a666c-8172-498c-819d-1e4d853690ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:28.877347 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-638a666c-8172-498c-819d-1e4d853690ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:28.877984 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-638a666c-8172-498c-819d-1e4d853690ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:28.882179 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-73ec067c-3613-4b74-954c-b4a9903ba076 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:28.890750 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-73ec067c-3613-4b74-954c-b4a9903ba076 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.171259 May 17 17:11:28.901061 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 91/169] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:28 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:29.039188 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-638a666c-8172-498c-819d-1e4d853690ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:29.046611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-638a666c-8172-498c-819d-1e4d853690ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1314 microversion: 2.1 time: 0.188936 May 17 17:11:29.047185 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 79/170] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:28 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:29.366639 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-322fabe2-c82d-4002-9d7f-9ce295081e69 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:29.367552 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-322fabe2-c82d-4002-9d7f-9ce295081e69 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:29.376806 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-322fabe2-c82d-4002-9d7f-9ce295081e69 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:29.377711 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-322fabe2-c82d-4002-9d7f-9ce295081e69 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:29.378838 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-322fabe2-c82d-4002-9d7f-9ce295081e69 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:29.379476 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-322fabe2-c82d-4002-9d7f-9ce295081e69 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:29.423510 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-322fabe2-c82d-4002-9d7f-9ce295081e69 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:29.424437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-322fabe2-c82d-4002-9d7f-9ce295081e69 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:29.425290 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-322fabe2-c82d-4002-9d7f-9ce295081e69 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lazy-loading 'fault' on Instance uuid 5d8fba30-1d0b-43ea-ad0c-11129104e39b {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:11:29.484175 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-322fabe2-c82d-4002-9d7f-9ce295081e69 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e161159bbc4339b6ac52213cc7b7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4111fd040fc4a4d823b5e38204286f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:29.494345 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-322fabe2-c82d-4002-9d7f-9ce295081e69 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 200 len: 1304 microversion: 2.1 time: 0.133638 May 17 17:11:29.495647 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 92/171] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:29 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:29.914908 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-cdd21c5c-6ad4-4bbb-a422-54c5e3e8a793 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:29.915596 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-cdd21c5c-6ad4-4bbb-a422-54c5e3e8a793 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:29.922751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-cdd21c5c-6ad4-4bbb-a422-54c5e3e8a793 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:29.923385 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-cdd21c5c-6ad4-4bbb-a422-54c5e3e8a793 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:29.924254 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-cdd21c5c-6ad4-4bbb-a422-54c5e3e8a793 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:29.924805 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-cdd21c5c-6ad4-4bbb-a422-54c5e3e8a793 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:30.060770 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-cdd21c5c-6ad4-4bbb-a422-54c5e3e8a793 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:30.063787 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8ee38863-f71a-47e4-a7e8-f1d3984a6852 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:30.064395 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8ee38863-f71a-47e4-a7e8-f1d3984a6852 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:30.068206 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-cdd21c5c-6ad4-4bbb-a422-54c5e3e8a793 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.158015 May 17 17:11:30.069997 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 80/172] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:29 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:30.071318 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8ee38863-f71a-47e4-a7e8-f1d3984a6852 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:30.071807 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8ee38863-f71a-47e4-a7e8-f1d3984a6852 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:30.072572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8ee38863-f71a-47e4-a7e8-f1d3984a6852 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:30.073000 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8ee38863-f71a-47e4-a7e8-f1d3984a6852 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:30.201427 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8ee38863-f71a-47e4-a7e8-f1d3984a6852 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:30.208725 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8ee38863-f71a-47e4-a7e8-f1d3984a6852 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1314 microversion: 2.1 time: 0.148711 May 17 17:11:30.210057 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 93/173] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:30 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:30.494163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-ffbc2d1e-e12c-4585-adbc-cbf58c0d42ec req-09307a7c-22c4-45ad-8ab0-861e65bfa839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225889dd-2500-40f8-8025-ebae658ee479", "tag": "08d82415-6640-48bc-b37b-4514b8cd0d80"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:30.502031 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-ffbc2d1e-e12c-4585-adbc-cbf58c0d42ec req-09307a7c-22c4-45ad-8ab0-861e65bfa839 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:30.502477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-ffbc2d1e-e12c-4585-adbc-cbf58c0d42ec req-09307a7c-22c4-45ad-8ab0-861e65bfa839 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:30.512057 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f089bfa9-53a1-44ce-ae08-685cc20c9c3d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:30.512675 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f089bfa9-53a1-44ce-ae08-685cc20c9c3d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:30.513592 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-ffbc2d1e-e12c-4585-adbc-cbf58c0d42ec req-09307a7c-22c4-45ad-8ab0-861e65bfa839 service nova] Creating event network-changed:08d82415-6640-48bc-b37b-4514b8cd0d80 for instance 225889dd-2500-40f8-8025-ebae658ee479 on hv-cinder-84214 May 17 17:11:30.518613 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-ffbc2d1e-e12c-4585-adbc-cbf58c0d42ec req-09307a7c-22c4-45ad-8ab0-861e65bfa839 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028578 May 17 17:11:30.518701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f089bfa9-53a1-44ce-ae08-685cc20c9c3d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:30.519163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 81/174] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:11:30.519279 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f089bfa9-53a1-44ce-ae08-685cc20c9c3d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:30.520322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f089bfa9-53a1-44ce-ae08-685cc20c9c3d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:30.520868 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f089bfa9-53a1-44ce-ae08-685cc20c9c3d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:30.535655 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-f089bfa9-53a1-44ce-ae08-685cc20c9c3d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] HTTP exception thrown: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f089bfa9-53a1-44ce-ae08-685cc20c9c3d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Request method failure captured: May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b HTTP/1.1 May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9b9ujdTazPIBHt6KWaerqmJet5-l5l5GfCbIh570UhOAkpNlPoq9yRgRRoEwroEdyLi3cc-78Ho22MW8Ja3_02jq-mlH5gjpCYcZkNMi_x12oypsahr7bNXwWTSEKS4BGIpP6NsVRtNd7vHDCooGb8TzaSSjUz83NNH_ToLHywbdbQ May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: b4111fd040fc4a4d823b5e38204286f7 May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-DeleteServersTestJSON-487158925 May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:11:30.540811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:11:30.542267 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:11:30.542267 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-DeleteServersTestJSON-487158925 May 17 17:11:30.542267 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: b4111fd040fc4a4d823b5e38204286f7 May 17 17:11:30.542267 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-DeleteServersTestJSON-487158925 May 17 17:11:30.542267 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-DeleteServersTestJSON-487158925-project May 17 17:11:30.542267 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:11:30.542267 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:11:30.542267 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 58e161159bbc4339b6ac52213cc7b7d1 May 17 17:11:30.542267 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-DeleteServersTestJSON-487158925-project May 17 17:11:30.542267 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:11:30.542267 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:30.542267 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '5d8fba30-1d0b-43ea-ad0c-11129104e39b'} May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:11:30.543132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:30.544701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:30.545926 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f089bfa9-53a1-44ce-ae08-685cc20c9c3d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Returning 404 to user: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:11:30.545926 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f089bfa9-53a1-44ce-ae08-685cc20c9c3d tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 404 len: 111 microversion: 2.1 time: 0.033846 May 17 17:11:30.546592 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 94/175] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:30 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 17:11:30.646700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-30b10904-46af-4bb2-97a7-6ce496dbf607 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:30.647728 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-30b10904-46af-4bb2-97a7-6ce496dbf607 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:30.653776 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-30b10904-46af-4bb2-97a7-6ce496dbf607 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:30.654233 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-30b10904-46af-4bb2-97a7-6ce496dbf607 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:30.654999 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-30b10904-46af-4bb2-97a7-6ce496dbf607 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:30.655439 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-30b10904-46af-4bb2-97a7-6ce496dbf607 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:30.668044 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-30b10904-46af-4bb2-97a7-6ce496dbf607 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] HTTP exception thrown: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-30b10904-46af-4bb2-97a7-6ce496dbf607 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Request method failure captured: May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b/os-volume_attachments HTTP/1.1 May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9b9ujdTazPIBHt6KWaerqmJet5-l5l5GfCbIh570UhOAkpNlPoq9yRgRRoEwroEdyLi3cc-78Ho22MW8Ja3_02jq-mlH5gjpCYcZkNMi_x12oypsahr7bNXwWTSEKS4BGIpP6NsVRtNd7vHDCooGb8TzaSSjUz83NNH_ToLHywbdbQ May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: b4111fd040fc4a4d823b5e38204286f7 May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-DeleteServersTestJSON-487158925 May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:11:30.671992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:11:30.673374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:11:30.673374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-DeleteServersTestJSON-487158925 May 17 17:11:30.673374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: b4111fd040fc4a4d823b5e38204286f7 May 17 17:11:30.673374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-DeleteServersTestJSON-487158925 May 17 17:11:30.673374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-DeleteServersTestJSON-487158925-project May 17 17:11:30.673374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:11:30.673374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:11:30.673374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 58e161159bbc4339b6ac52213cc7b7d1 May 17 17:11:30.673374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-DeleteServersTestJSON-487158925-project May 17 17:11:30.673374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:11:30.673374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:30.673374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'server_id': '5d8fba30-1d0b-43ea-ad0c-11129104e39b'} May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:11:30.674052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:30.675147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:11:30.676211 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-30b10904-46af-4bb2-97a7-6ce496dbf607 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Returning 404 to user: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:11:30.676211 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-30b10904-46af-4bb2-97a7-6ce496dbf607 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030977 May 17 17:11:30.676211 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 82/176] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:11:30 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:11:31.086128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-fd6f95e1-40f5-450f-96e1-c2be6a7bf69f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:31.086662 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-fd6f95e1-40f5-450f-96e1-c2be6a7bf69f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:31.092775 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fd6f95e1-40f5-450f-96e1-c2be6a7bf69f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:31.093214 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fd6f95e1-40f5-450f-96e1-c2be6a7bf69f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:31.093972 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fd6f95e1-40f5-450f-96e1-c2be6a7bf69f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:31.094400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fd6f95e1-40f5-450f-96e1-c2be6a7bf69f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:31.220210 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-fd6f95e1-40f5-450f-96e1-c2be6a7bf69f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:31.227192 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-54024fdc-c560-4bad-b562-f147b8a09fb1 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:31.227867 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-54024fdc-c560-4bad-b562-f147b8a09fb1 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:31.228577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-fd6f95e1-40f5-450f-96e1-c2be6a7bf69f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.146564 May 17 17:11:31.229154 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 95/177] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:31 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:31.234280 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-54024fdc-c560-4bad-b562-f147b8a09fb1 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:31.234730 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-54024fdc-c560-4bad-b562-f147b8a09fb1 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:31.235497 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-54024fdc-c560-4bad-b562-f147b8a09fb1 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:31.235963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-54024fdc-c560-4bad-b562-f147b8a09fb1 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:31.365679 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-54024fdc-c560-4bad-b562-f147b8a09fb1 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:31.373068 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-54024fdc-c560-4bad-b562-f147b8a09fb1 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1314 microversion: 2.1 time: 0.150754 May 17 17:11:31.373626 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 83/178] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:31 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:32.245941 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2a283e56-6d07-4829-b952-c9b9b5ffb7da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:32.246457 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2a283e56-6d07-4829-b952-c9b9b5ffb7da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:32.252341 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2a283e56-6d07-4829-b952-c9b9b5ffb7da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:32.252795 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2a283e56-6d07-4829-b952-c9b9b5ffb7da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:32.253550 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2a283e56-6d07-4829-b952-c9b9b5ffb7da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:32.253984 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2a283e56-6d07-4829-b952-c9b9b5ffb7da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:32.383874 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2a283e56-6d07-4829-b952-c9b9b5ffb7da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:32.389701 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4c9cee71-27d2-4daa-9631-c742162c751e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:32.390316 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4c9cee71-27d2-4daa-9631-c742162c751e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:32.391174 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2a283e56-6d07-4829-b952-c9b9b5ffb7da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.149179 May 17 17:11:32.391860 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 96/179] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:32 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:32.396845 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c9cee71-27d2-4daa-9631-c742162c751e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:32.397300 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c9cee71-27d2-4daa-9631-c742162c751e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:32.398074 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c9cee71-27d2-4daa-9631-c742162c751e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:32.398513 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c9cee71-27d2-4daa-9631-c742162c751e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:32.523056 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4c9cee71-27d2-4daa-9631-c742162c751e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:32.530304 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4c9cee71-27d2-4daa-9631-c742162c751e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1314 microversion: 2.1 time: 0.144615 May 17 17:11:32.530862 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 84/180] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:32 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:33.412191 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-49bba75b-c28d-41b3-993e-8e0dcc9031f8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:33.413172 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-49bba75b-c28d-41b3-993e-8e0dcc9031f8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:33.418891 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-49bba75b-c28d-41b3-993e-8e0dcc9031f8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:33.419341 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-49bba75b-c28d-41b3-993e-8e0dcc9031f8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:33.420327 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-49bba75b-c28d-41b3-993e-8e0dcc9031f8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:33.420767 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-49bba75b-c28d-41b3-993e-8e0dcc9031f8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:33.548322 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7df41795-8ec2-44d4-866e-cd602f8e127a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:33.549843 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7df41795-8ec2-44d4-866e-cd602f8e127a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:33.556532 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-49bba75b-c28d-41b3-993e-8e0dcc9031f8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:33.557199 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7df41795-8ec2-44d4-866e-cd602f8e127a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:33.557653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7df41795-8ec2-44d4-866e-cd602f8e127a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:33.558441 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7df41795-8ec2-44d4-866e-cd602f8e127a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:33.558883 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7df41795-8ec2-44d4-866e-cd602f8e127a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:33.566191 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-49bba75b-c28d-41b3-993e-8e0dcc9031f8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.158275 May 17 17:11:33.566913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 97/181] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:33 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:33.686943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7df41795-8ec2-44d4-866e-cd602f8e127a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:33.694900 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7df41795-8ec2-44d4-866e-cd602f8e127a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1314 microversion: 2.1 time: 0.150351 May 17 17:11:33.695690 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 85/182] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:33 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:33.958257 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c465325c-b483-45a6-acd2-1328a2630025 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:33.958759 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c465325c-b483-45a6-acd2-1328a2630025 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:33.965443 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c465325c-b483-45a6-acd2-1328a2630025 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:33.966074 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c465325c-b483-45a6-acd2-1328a2630025 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:33.966885 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c465325c-b483-45a6-acd2-1328a2630025 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:33.967329 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c465325c-b483-45a6-acd2-1328a2630025 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:33.981462 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-c465325c-b483-45a6-acd2-1328a2630025 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] HTTP exception thrown: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c465325c-b483-45a6-acd2-1328a2630025 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Request method failure captured: May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: DELETE /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b HTTP/1.1 May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9b9ujdTazPIBHt6KWaerqmJet5-l5l5GfCbIh570UhOAkpNlPoq9yRgRRoEwroEdyLi3cc-78Ho22MW8Ja3_02jq-mlH5gjpCYcZkNMi_x12oypsahr7bNXwWTSEKS4BGIpP6NsVRtNd7vHDCooGb8TzaSSjUz83NNH_ToLHywbdbQ May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: b4111fd040fc4a4d823b5e38204286f7 May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-DeleteServersTestJSON-487158925 May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:11:33.983589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:11:33.985040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:11:33.985040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-DeleteServersTestJSON-487158925 May 17 17:11:33.985040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: b4111fd040fc4a4d823b5e38204286f7 May 17 17:11:33.985040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-DeleteServersTestJSON-487158925 May 17 17:11:33.985040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-DeleteServersTestJSON-487158925-project May 17 17:11:33.985040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:11:33.985040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:11:33.985040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 58e161159bbc4339b6ac52213cc7b7d1 May 17 17:11:33.985040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-DeleteServersTestJSON-487158925-project May 17 17:11:33.985040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:11:33.985040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:33.985040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '5d8fba30-1d0b-43ea-ad0c-11129104e39b'} May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:11:33.985846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:33.987146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:33.989205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c465325c-b483-45a6-acd2-1328a2630025 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Returning 404 to user: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:11:33.990228 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c465325c-b483-45a6-acd2-1328a2630025 tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 404 len: 111 microversion: 2.1 time: 0.036654 May 17 17:11:33.990942 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 98/183] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:11:33 2022] DELETE /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:11:33.998962 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-10bb859a-5950-473c-9515-3317bb19cc5c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:33.999679 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-10bb859a-5950-473c-9515-3317bb19cc5c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] [instance: 5d8fba30-1d0b-43ea-ad0c-11129104e39b] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:34.007943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-10bb859a-5950-473c-9515-3317bb19cc5c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:34.009056 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-10bb859a-5950-473c-9515-3317bb19cc5c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:34.010040 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-10bb859a-5950-473c-9515-3317bb19cc5c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:34.010511 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-10bb859a-5950-473c-9515-3317bb19cc5c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:34.031276 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-10bb859a-5950-473c-9515-3317bb19cc5c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] HTTP exception thrown: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-10bb859a-5950-473c-9515-3317bb19cc5c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Request method failure captured: May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b HTTP/1.1 May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9b9ujdTazPIBHt6KWaerqmJet5-l5l5GfCbIh570UhOAkpNlPoq9yRgRRoEwroEdyLi3cc-78Ho22MW8Ja3_02jq-mlH5gjpCYcZkNMi_x12oypsahr7bNXwWTSEKS4BGIpP6NsVRtNd7vHDCooGb8TzaSSjUz83NNH_ToLHywbdbQ May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: b4111fd040fc4a4d823b5e38204286f7 May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-DeleteServersTestJSON-487158925 May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:11:34.033500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:11:34.035001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b4111fd040fc4a4d823b5e38204286f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:11:34.035001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-DeleteServersTestJSON-487158925 May 17 17:11:34.035001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: b4111fd040fc4a4d823b5e38204286f7 May 17 17:11:34.035001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-DeleteServersTestJSON-487158925 May 17 17:11:34.035001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-DeleteServersTestJSON-487158925-project May 17 17:11:34.035001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:11:34.035001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:11:34.035001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 58e161159bbc4339b6ac52213cc7b7d1 May 17 17:11:34.035001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-DeleteServersTestJSON-487158925-project May 17 17:11:34.035001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:11:34.035001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:34.035001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': '5d8fba30-1d0b-43ea-ad0c-11129104e39b'} May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:11:34.036156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. May 17 17:11:34.037614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:11:34.039490 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-10bb859a-5950-473c-9515-3317bb19cc5c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] Returning 404 to user: Instance 5d8fba30-1d0b-43ea-ad0c-11129104e39b could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:11:34.039490 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-10bb859a-5950-473c-9515-3317bb19cc5c tempest-DeleteServersTestJSON-487158925 tempest-DeleteServersTestJSON-487158925-project] 10.222.0.48 "GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b" status: 404 len: 111 microversion: 2.1 time: 0.039818 May 17 17:11:34.039490 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 86/184] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:33 2022] GET /compute/v2.1/servers/5d8fba30-1d0b-43ea-ad0c-11129104e39b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:11:34.585294 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8d1d3abe-3d43-4149-b5ae-a593ab3411e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:34.586001 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8d1d3abe-3d43-4149-b5ae-a593ab3411e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:34.595863 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8d1d3abe-3d43-4149-b5ae-a593ab3411e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:34.595863 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8d1d3abe-3d43-4149-b5ae-a593ab3411e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:34.595863 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8d1d3abe-3d43-4149-b5ae-a593ab3411e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:34.595863 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8d1d3abe-3d43-4149-b5ae-a593ab3411e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:34.712390 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-30b428fa-ed10-478c-8801-2b2b7a8cbd11 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:34.713580 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-30b428fa-ed10-478c-8801-2b2b7a8cbd11 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:34.721306 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-30b428fa-ed10-478c-8801-2b2b7a8cbd11 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:34.722138 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-30b428fa-ed10-478c-8801-2b2b7a8cbd11 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:34.723672 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-30b428fa-ed10-478c-8801-2b2b7a8cbd11 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:34.724264 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-30b428fa-ed10-478c-8801-2b2b7a8cbd11 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:34.951035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8d1d3abe-3d43-4149-b5ae-a593ab3411e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:34.968785 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8d1d3abe-3d43-4149-b5ae-a593ab3411e8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.388264 May 17 17:11:34.969797 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 99/185] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:34 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:34.982253 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-30b428fa-ed10-478c-8801-2b2b7a8cbd11 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:34.989459 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-30b428fa-ed10-478c-8801-2b2b7a8cbd11 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1314 microversion: 2.1 time: 0.281327 May 17 17:11:34.990800 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 87/186] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:34 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:35.991211 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5c053030-9774-4ca3-808e-80ee4fba2717 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:35.992535 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5c053030-9774-4ca3-808e-80ee4fba2717 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:36.006033 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5c053030-9774-4ca3-808e-80ee4fba2717 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:36.006786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5c053030-9774-4ca3-808e-80ee4fba2717 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:36.007818 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5c053030-9774-4ca3-808e-80ee4fba2717 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:36.008438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5c053030-9774-4ca3-808e-80ee4fba2717 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:36.009137 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f1b85232-db61-40ff-882b-7f90b28803ae tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:36.010820 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f1b85232-db61-40ff-882b-7f90b28803ae tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:36.018426 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f1b85232-db61-40ff-882b-7f90b28803ae tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:36.019180 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f1b85232-db61-40ff-882b-7f90b28803ae tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:36.020929 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f1b85232-db61-40ff-882b-7f90b28803ae tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:36.022252 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f1b85232-db61-40ff-882b-7f90b28803ae tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:36.253432 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5c053030-9774-4ca3-808e-80ee4fba2717 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:36.266109 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5c053030-9774-4ca3-808e-80ee4fba2717 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.278904 May 17 17:11:36.267920 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 100/187] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:35 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:36.305024 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f1b85232-db61-40ff-882b-7f90b28803ae tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:36.313445 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f1b85232-db61-40ff-882b-7f90b28803ae tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1314 microversion: 2.1 time: 0.309133 May 17 17:11:36.314519 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 88/188] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:36 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:36.745785 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-e311e973-57d0-4183-9653-ead9a2d7e45c req-8d5039e7-c917-4eee-82f8-1000d7ba6308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225889dd-2500-40f8-8025-ebae658ee479", "name": "network-vif-plugged", "status": "completed", "tag": "08d82415-6640-48bc-b37b-4514b8cd0d80"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:36.754645 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-e311e973-57d0-4183-9653-ead9a2d7e45c req-8d5039e7-c917-4eee-82f8-1000d7ba6308 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:36.754992 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-e311e973-57d0-4183-9653-ead9a2d7e45c req-8d5039e7-c917-4eee-82f8-1000d7ba6308 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:36.768296 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-e311e973-57d0-4183-9653-ead9a2d7e45c req-8d5039e7-c917-4eee-82f8-1000d7ba6308 service nova] Creating event network-vif-plugged:08d82415-6640-48bc-b37b-4514b8cd0d80 for instance 225889dd-2500-40f8-8025-ebae658ee479 on hv-cinder-84214 May 17 17:11:36.776076 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-e311e973-57d0-4183-9653-ead9a2d7e45c req-8d5039e7-c917-4eee-82f8-1000d7ba6308 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035012 May 17 17:11:36.776838 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 101/189] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:11:37.283972 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-df69b10c-294c-45b2-b400-107dcc7043be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:37.285276 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-df69b10c-294c-45b2-b400-107dcc7043be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:37.304617 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df69b10c-294c-45b2-b400-107dcc7043be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:37.305765 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df69b10c-294c-45b2-b400-107dcc7043be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:37.307517 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df69b10c-294c-45b2-b400-107dcc7043be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:37.308977 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df69b10c-294c-45b2-b400-107dcc7043be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:37.338588 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3dd03838-5aeb-4e70-b364-c77ede35a7fc tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:37.339321 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-3dd03838-5aeb-4e70-b364-c77ede35a7fc tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:37.354533 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3dd03838-5aeb-4e70-b364-c77ede35a7fc tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:37.370710 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3dd03838-5aeb-4e70-b364-c77ede35a7fc tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:37.374755 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3dd03838-5aeb-4e70-b364-c77ede35a7fc tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:37.375400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3dd03838-5aeb-4e70-b364-c77ede35a7fc tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:37.592955 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-df69b10c-294c-45b2-b400-107dcc7043be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:37.643689 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-df69b10c-294c-45b2-b400-107dcc7043be tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.359995 May 17 17:11:37.644962 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 89/190] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:37 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:37.673836 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-3dd03838-5aeb-4e70-b364-c77ede35a7fc tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:37.682272 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-3dd03838-5aeb-4e70-b364-c77ede35a7fc tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1314 microversion: 2.1 time: 0.355800 May 17 17:11:37.688493 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 102/191] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:37 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:38.661066 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-367f0a73-0fe4-40f1-8a0e-eb92372847a4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:38.661703 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-367f0a73-0fe4-40f1-8a0e-eb92372847a4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:38.671420 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-367f0a73-0fe4-40f1-8a0e-eb92372847a4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:38.672072 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-367f0a73-0fe4-40f1-8a0e-eb92372847a4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:38.673515 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-367f0a73-0fe4-40f1-8a0e-eb92372847a4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:38.674241 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-367f0a73-0fe4-40f1-8a0e-eb92372847a4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:38.713829 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-73a73acf-2efc-4709-b0de-0b3a6d74cb8e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:38.714887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-73a73acf-2efc-4709-b0de-0b3a6d74cb8e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:38.735141 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-73a73acf-2efc-4709-b0de-0b3a6d74cb8e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:38.735650 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-73a73acf-2efc-4709-b0de-0b3a6d74cb8e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:38.736420 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-73a73acf-2efc-4709-b0de-0b3a6d74cb8e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:38.736854 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-73a73acf-2efc-4709-b0de-0b3a6d74cb8e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:39.471879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-367f0a73-0fe4-40f1-8a0e-eb92372847a4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:39.484662 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-367f0a73-0fe4-40f1-8a0e-eb92372847a4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.827312 May 17 17:11:39.495744 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 90/192] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:38 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:39.524632 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-73a73acf-2efc-4709-b0de-0b3a6d74cb8e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:39.538392 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-73a73acf-2efc-4709-b0de-0b3a6d74cb8e tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1314 microversion: 2.1 time: 0.835364 May 17 17:11:39.548765 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 103/193] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:38 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1314 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:40.502135 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-459771ea-6101-4fae-9d74-78578b2d4c76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:40.502712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-459771ea-6101-4fae-9d74-78578b2d4c76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:40.514940 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-459771ea-6101-4fae-9d74-78578b2d4c76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:40.516676 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-459771ea-6101-4fae-9d74-78578b2d4c76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:40.525691 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-459771ea-6101-4fae-9d74-78578b2d4c76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:40.526530 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-459771ea-6101-4fae-9d74-78578b2d4c76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:40.568827 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2889a413-f2e2-41ee-9388-8d1bcf953be9 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:40.569583 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2889a413-f2e2-41ee-9388-8d1bcf953be9 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:40.580996 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2889a413-f2e2-41ee-9388-8d1bcf953be9 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:40.581684 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2889a413-f2e2-41ee-9388-8d1bcf953be9 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:40.582704 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2889a413-f2e2-41ee-9388-8d1bcf953be9 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:40.583294 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2889a413-f2e2-41ee-9388-8d1bcf953be9 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:40.994794 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2889a413-f2e2-41ee-9388-8d1bcf953be9 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:41.004792 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2889a413-f2e2-41ee-9388-8d1bcf953be9 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1498 microversion: 2.1 time: 0.450528 May 17 17:11:41.009164 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-459771ea-6101-4fae-9d74-78578b2d4c76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:41.018993 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 104/194] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:40 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1498 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:41.022617 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-459771ea-6101-4fae-9d74-78578b2d4c76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.524188 May 17 17:11:41.023194 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 91/195] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:40 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:41.702578 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-0d18fa27-5e09-4d31-bf1a-f21e54b7705a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:41.703370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-0d18fa27-5e09-4d31-bf1a-f21e54b7705a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:41.719067 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0d18fa27-5e09-4d31-bf1a-f21e54b7705a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:41.719832 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0d18fa27-5e09-4d31-bf1a-f21e54b7705a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:41.721052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0d18fa27-5e09-4d31-bf1a-f21e54b7705a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:41.721687 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0d18fa27-5e09-4d31-bf1a-f21e54b7705a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:41.773275 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-0d18fa27-5e09-4d31-bf1a-f21e54b7705a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Going to try to terminate instance {{(pid=117090) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:11:41.929841 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-0d18fa27-5e09-4d31-bf1a-f21e54b7705a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "DELETE /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 204 len: 0 microversion: 2.1 time: 0.235243 May 17 17:11:41.930833 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 105/196] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:11:41 2022] DELETE /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:11:41.939226 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-423083fa-4970-4fe3-9054-8c234cdf9b7b tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:41.940146 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-423083fa-4970-4fe3-9054-8c234cdf9b7b tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:41.951723 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-423083fa-4970-4fe3-9054-8c234cdf9b7b tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:41.952495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-423083fa-4970-4fe3-9054-8c234cdf9b7b tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:41.953440 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-423083fa-4970-4fe3-9054-8c234cdf9b7b tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:41.954121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-423083fa-4970-4fe3-9054-8c234cdf9b7b tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:42.043190 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-549f80ec-5dc3-4bc5-84b7-e460a46c4975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:42.044409 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-549f80ec-5dc3-4bc5-84b7-e460a46c4975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:42.056938 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-549f80ec-5dc3-4bc5-84b7-e460a46c4975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:42.057714 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-549f80ec-5dc3-4bc5-84b7-e460a46c4975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:42.060020 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-549f80ec-5dc3-4bc5-84b7-e460a46c4975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:42.063086 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-549f80ec-5dc3-4bc5-84b7-e460a46c4975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:42.356799 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-549f80ec-5dc3-4bc5-84b7-e460a46c4975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:42.363297 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-423083fa-4970-4fe3-9054-8c234cdf9b7b tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:42.368853 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-549f80ec-5dc3-4bc5-84b7-e460a46c4975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.330946 May 17 17:11:42.378584 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 106/197] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:42 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:42.383561 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-423083fa-4970-4fe3-9054-8c234cdf9b7b tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1504 microversion: 2.1 time: 0.448389 May 17 17:11:42.384467 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 92/198] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:41 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1504 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:43.386526 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1bd1a439-7160-4e56-bf78-df4b01d38184 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:43.388076 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1bd1a439-7160-4e56-bf78-df4b01d38184 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:43.395985 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1bd1a439-7160-4e56-bf78-df4b01d38184 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:43.396728 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1bd1a439-7160-4e56-bf78-df4b01d38184 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:43.399836 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1bd1a439-7160-4e56-bf78-df4b01d38184 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:43.400511 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1bd1a439-7160-4e56-bf78-df4b01d38184 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:43.611126 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1bd1a439-7160-4e56-bf78-df4b01d38184 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:43.620754 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1bd1a439-7160-4e56-bf78-df4b01d38184 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.238310 May 17 17:11:43.621546 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 93/199] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:43 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:43.626955 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d5d2de71-9542-4855-83ea-b581c7957c48 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:43.638132 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d5d2de71-9542-4855-83ea-b581c7957c48 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:43.670359 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-cfe75096-b78d-41cc-bfcd-0d4c27772e29 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Action: 'create', calling method: .version_select at 0x7feb18238940>, body: {"keypair": {"name": "tempest-keypair-646647193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExsHk1HFNfqbrxT9JkhvPegad2sLsDpBUVMqb65N9k3eFQ/3X/PLrHgpGRNG2YXwkdr848uJfk/tdIpOSdmeabExguKYDA0x2qhrvdqdUhs4gYy61Qep3enfFhkEpMaFA=="}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:43.682254 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d5d2de71-9542-4855-83ea-b581c7957c48 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:43.682824 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d5d2de71-9542-4855-83ea-b581c7957c48 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:43.683522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d5d2de71-9542-4855-83ea-b581c7957c48 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:43.685872 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d5d2de71-9542-4855-83ea-b581c7957c48 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:43.713345 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-cfe75096-b78d-41cc-bfcd-0d4c27772e29 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'key_pairs'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:11:43.723332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-cfe75096-b78d-41cc-bfcd-0d4c27772e29 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for user 61daaf70d25c4e1592fcb2f4feafff86 and project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'key_pairs'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:11:43.779397 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-cfe75096-b78d-41cc-bfcd-0d4c27772e29 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.508439 May 17 17:11:43.780484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 107/200] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 17 17:11:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:11:43.889723 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d5d2de71-9542-4855-83ea-b581c7957c48 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:43.897945 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d5d2de71-9542-4855-83ea-b581c7957c48 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1504 microversion: 2.1 time: 0.275045 May 17 17:11:43.899033 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 94/201] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:43 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1504 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:44.658681 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-99896ef9-a201-4b7a-a843-eefa52c7116e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:44.662446 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-99896ef9-a201-4b7a-a843-eefa52c7116e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:44.683334 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99896ef9-a201-4b7a-a843-eefa52c7116e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:44.685053 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-72dc0dfc-51c8-4fd6-96bd-19206bc9fefe req-e6acdf28-caf8-4c71-b1ee-23cc82edef50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225889dd-2500-40f8-8025-ebae658ee479", "name": "network-vif-deleted", "tag": "08d82415-6640-48bc-b37b-4514b8cd0d80"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:44.685851 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99896ef9-a201-4b7a-a843-eefa52c7116e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:44.689813 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99896ef9-a201-4b7a-a843-eefa52c7116e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:44.691834 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99896ef9-a201-4b7a-a843-eefa52c7116e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:44.719578 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-72dc0dfc-51c8-4fd6-96bd-19206bc9fefe req-e6acdf28-caf8-4c71-b1ee-23cc82edef50 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:44.720427 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-72dc0dfc-51c8-4fd6-96bd-19206bc9fefe req-e6acdf28-caf8-4c71-b1ee-23cc82edef50 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:44.778237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-72dc0dfc-51c8-4fd6-96bd-19206bc9fefe req-e6acdf28-caf8-4c71-b1ee-23cc82edef50 service nova] Creating event network-vif-deleted:08d82415-6640-48bc-b37b-4514b8cd0d80 for instance 225889dd-2500-40f8-8025-ebae658ee479 on hv-cinder-84214 May 17 17:11:44.806576 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-72dc0dfc-51c8-4fd6-96bd-19206bc9fefe req-e6acdf28-caf8-4c71-b1ee-23cc82edef50 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128504 May 17 17:11:44.807536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 95/202] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:11:44.932892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-847831aa-c514-4669-a15d-7c38bba90f44 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:44.934442 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-847831aa-c514-4669-a15d-7c38bba90f44 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:44.982903 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-847831aa-c514-4669-a15d-7c38bba90f44 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:44.983707 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-847831aa-c514-4669-a15d-7c38bba90f44 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:44.988864 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-847831aa-c514-4669-a15d-7c38bba90f44 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:44.990629 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-847831aa-c514-4669-a15d-7c38bba90f44 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:45.085313 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-99896ef9-a201-4b7a-a843-eefa52c7116e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:45.093289 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-99896ef9-a201-4b7a-a843-eefa52c7116e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.457357 May 17 17:11:45.093460 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-847831aa-c514-4669-a15d-7c38bba90f44 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:45.094024 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-847831aa-c514-4669-a15d-7c38bba90f44 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:45.094624 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-847831aa-c514-4669-a15d-7c38bba90f44 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lazy-loading 'fault' on Instance uuid 225889dd-2500-40f8-8025-ebae658ee479 {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:11:45.112011 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 108/203] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:44 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:45.219490 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-847831aa-c514-4669-a15d-7c38bba90f44 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:45.245629 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-847831aa-c514-4669-a15d-7c38bba90f44 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 200 len: 1304 microversion: 2.1 time: 0.333121 May 17 17:11:45.247848 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 96/204] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:44 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 1304 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:45.298650 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1579925720", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "networks": [{"uuid": "6c7d9c40-84df-4392-abe5-e887770a65c6"}]}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:45.414018 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.network.neutron [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] validate_networks() for [('6c7d9c40-84df-4392-abe5-e887770a65c6', None, None, None, None, None)] {{(pid=117090) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:11:45.936885 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Flavor limits 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:11:45.937499 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Image limits 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:11:45.937821 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Flavor pref 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:11:45.938823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Image pref 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:11:45.939360 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:11:45.960392 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:45.961023 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:45.963417 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:45.963961 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:45.995406 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Getting quotas for project 260311245b60460283c01ebc87cb5bc2. Resources: {'ram', 'instances', 'cores'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:11:45.999865 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Getting quotas for user d7b9ce69a40845c5adef40e3e0355747 and project 260311245b60460283c01ebc87cb5bc2. Resources: {'ram', 'instances', 'cores'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:11:46.014067 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Going to run 1 instances... {{(pid=117090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:11:46.016795 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:11:46.101504 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-3294f342-5b9d-4022-86c4-b3de3f5c27c7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.807346 May 17 17:11:46.102495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 109/205] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:11:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:11:46.115962 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-c701acb6-13d9-42c6-a5fa-8dad73c16f8b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:46.117207 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-c701acb6-13d9-42c6-a5fa-8dad73c16f8b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:46.141563 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-838c7640-2603-4100-ae18-ff2d26beede8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:46.142345 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-838c7640-2603-4100-ae18-ff2d26beede8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:46.143974 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c701acb6-13d9-42c6-a5fa-8dad73c16f8b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:46.144632 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c701acb6-13d9-42c6-a5fa-8dad73c16f8b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:46.147171 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c701acb6-13d9-42c6-a5fa-8dad73c16f8b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:46.148885 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c701acb6-13d9-42c6-a5fa-8dad73c16f8b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:46.230820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-838c7640-2603-4100-ae18-ff2d26beede8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:46.239058 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-838c7640-2603-4100-ae18-ff2d26beede8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1219 microversion: 2.1 time: 0.101349 May 17 17:11:46.242887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 110/206] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:46 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:46.275892 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-30da6bdc-35e7-44d4-b96e-d78a4a2a1e62 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:46.277506 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-30da6bdc-35e7-44d4-b96e-d78a4a2a1e62 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 225889dd-2500-40f8-8025-ebae658ee479] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:46.288216 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-30da6bdc-35e7-44d4-b96e-d78a4a2a1e62 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:46.288934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-30da6bdc-35e7-44d4-b96e-d78a4a2a1e62 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:46.291169 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-30da6bdc-35e7-44d4-b96e-d78a4a2a1e62 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:46.292116 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-30da6bdc-35e7-44d4-b96e-d78a4a2a1e62 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:46.317005 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-30da6bdc-35e7-44d4-b96e-d78a4a2a1e62 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] HTTP exception thrown: Instance 225889dd-2500-40f8-8025-ebae658ee479 could not be found. May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-30da6bdc-35e7-44d4-b96e-d78a4a2a1e62 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Request method failure captured: May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 HTTP/1.1 May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9c4bYRWqR9m7EyiGA_qvsIuZMvt8fbGt5-AM1ddPGSsXkTESqpOwQ6ZZw3cNYBFq_0Z8olMB2bVCEcSiApSopY7C3vD2NGucrgr_2pJ_o1lVZNHCF-O_3ZlQg2M6On3h9qudCSyUeXq-4sUvJXu3hV9fV5yfvCPg1KBWIRYdQoNCBw May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: b5858756d2b74673a765c1d2e6adf280 May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-VolumesActionsTest-1378399647 May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:11:46.323052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:11:46.324514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b5858756d2b74673a765c1d2e6adf280"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b5858756d2b74673a765c1d2e6adf280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b5858756d2b74673a765c1d2e6adf280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b5858756d2b74673a765c1d2e6adf280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:11:46.324514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-VolumesActionsTest-1378399647 May 17 17:11:46.324514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: b5858756d2b74673a765c1d2e6adf280 May 17 17:11:46.324514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-VolumesActionsTest-1378399647 May 17 17:11:46.324514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-VolumesActionsTest-1378399647-project May 17 17:11:46.324514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:11:46.324514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:11:46.324514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: c3feefbd066d49148171c392838b4e15 May 17 17:11:46.324514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-VolumesActionsTest-1378399647-project May 17 17:11:46.324514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:11:46.324514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance 225889dd-2500-40f8-8025-ebae658ee479 could not be found. May 17 17:11:46.324514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '225889dd-2500-40f8-8025-ebae658ee479'} May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 225889dd-2500-40f8-8025-ebae658ee479 could not be found. May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:11:46.325256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 225889dd-2500-40f8-8025-ebae658ee479 could not be found. May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 225889dd-2500-40f8-8025-ebae658ee479 could not be found. May 17 17:11:46.326637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:11:46.339635 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-30da6bdc-35e7-44d4-b96e-d78a4a2a1e62 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Returning 404 to user: Instance 225889dd-2500-40f8-8025-ebae658ee479 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:11:46.341549 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-30da6bdc-35e7-44d4-b96e-d78a4a2a1e62 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479" status: 404 len: 111 microversion: 2.1 time: 0.069819 May 17 17:11:46.357492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 111/207] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:46 2022] GET /compute/v2.1/servers/225889dd-2500-40f8-8025-ebae658ee479 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 17:11:46.417271 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-c701acb6-13d9-42c6-a5fa-8dad73c16f8b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:46.436735 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-c701acb6-13d9-42c6-a5fa-8dad73c16f8b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.320731 May 17 17:11:46.437665 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 97/208] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:46 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:46.527190 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1283826135", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "networks": [{"uuid": "70c87c86-2820-494f-92b7-3ef8c78c46f3"}]}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:46.550856 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-641145912", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30541785-dceb-40b7-9575-992b66a470e9"}], "security_groups": [{"name": "tempest-securitygroup--1917651284"}], "key_name": "tempest-keypair-646647193", "user_data": "}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:46.615696 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.network.neutron [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] validate_networks() for [('70c87c86-2820-494f-92b7-3ef8c78c46f3', None, None, None, None, None)] {{(pid=117090) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:11:46.778623 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] validate_networks() for [('30541785-dceb-40b7-9575-992b66a470e9', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:11:47.601263 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Flavor limits 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:11:47.603856 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Image limits 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:11:47.604977 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Flavor pref 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:11:47.606065 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Image pref 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:11:47.606996 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:11:47.633549 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:47.636520 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:47.637860 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:47.640386 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:47.698704 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Getting quotas for project b5858756d2b74673a765c1d2e6adf280. Resources: {'ram', 'instances', 'cores'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:11:47.735763 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Getting quotas for user c3feefbd066d49148171c392838b4e15 and project b5858756d2b74673a765c1d2e6adf280. Resources: {'ram', 'instances', 'cores'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:11:47.774865 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Going to run 1 instances... {{(pid=117090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:11:47.778706 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:11:47.784894 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:11:47.785648 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:11:47.787019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:11:47.787869 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:11:47.788390 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:11:47.802227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:47.802900 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:47.803947 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:47.804490 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:47.825200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:11:47.830080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for user 61daaf70d25c4e1592fcb2f4feafff86 and project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:11:47.844115 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:11:47.846719 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:11:47.872738 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9b3d37f7-05ef-46a2-a77e-7b08e526df53 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349502 May 17 17:11:47.874295 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 112/209] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:11:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:11:47.885657 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-0e6b4c51-92d3-4fe0-b0e5-0f2b525b96c5 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:47.886981 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-0e6b4c51-92d3-4fe0-b0e5-0f2b525b96c5 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:47.908431 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0e6b4c51-92d3-4fe0-b0e5-0f2b525b96c5 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:47.909797 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0e6b4c51-92d3-4fe0-b0e5-0f2b525b96c5 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:47.912253 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0e6b4c51-92d3-4fe0-b0e5-0f2b525b96c5 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:47.913432 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0e6b4c51-92d3-4fe0-b0e5-0f2b525b96c5 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:47.967757 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ffafa3de-c786-4740-9540-d79496676621 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.423539 May 17 17:11:47.974386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 98/210] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:11:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:11:47.979826 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-12e248ae-f44a-40fb-8c3c-42c04701f965 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:47.994312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-12e248ae-f44a-40fb-8c3c-42c04701f965 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:48.006505 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-12e248ae-f44a-40fb-8c3c-42c04701f965 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:48.006963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-12e248ae-f44a-40fb-8c3c-42c04701f965 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:48.007777 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-12e248ae-f44a-40fb-8c3c-42c04701f965 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:48.008222 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-12e248ae-f44a-40fb-8c3c-42c04701f965 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:48.159437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-0e6b4c51-92d3-4fe0-b0e5-0f2b525b96c5 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:48.184098 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-0e6b4c51-92d3-4fe0-b0e5-0f2b525b96c5 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1277 microversion: 2.1 time: 0.307884 May 17 17:11:48.185082 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 113/211] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:47 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1277 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:48.203155 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-37f317df-e4d4-40f5-b833-1ce994566130 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:48.203923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-37f317df-e4d4-40f5-b833-1ce994566130 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:48.355864 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-37f317df-e4d4-40f5-b833-1ce994566130 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:48.383924 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-37f317df-e4d4-40f5-b833-1ce994566130 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1214 microversion: 2.1 time: 0.191589 May 17 17:11:48.388901 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 114/212] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:48 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1214 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:48.413305 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1406f959-7b0f-477b-9371-7d59bf5527ed tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:48.420828 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1406f959-7b0f-477b-9371-7d59bf5527ed tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:48.505466 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-12e248ae-f44a-40fb-8c3c-42c04701f965 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:48.542146 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-12e248ae-f44a-40fb-8c3c-42c04701f965 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.565994 May 17 17:11:48.543234 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 99/213] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:47 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:48.664376 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1406f959-7b0f-477b-9371-7d59bf5527ed tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:48.678404 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1406f959-7b0f-477b-9371-7d59bf5527ed tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1240 microversion: 2.1 time: 0.281101 May 17 17:11:48.679205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 115/214] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:48 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1240 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:49.228300 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2a11bfce-3f7a-4f32-b59f-95e0ba088251 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:49.228982 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2a11bfce-3f7a-4f32-b59f-95e0ba088251 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:49.238233 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2a11bfce-3f7a-4f32-b59f-95e0ba088251 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:49.238912 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2a11bfce-3f7a-4f32-b59f-95e0ba088251 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:49.240944 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2a11bfce-3f7a-4f32-b59f-95e0ba088251 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:49.241546 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2a11bfce-3f7a-4f32-b59f-95e0ba088251 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:49.418823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-018a1c85-d6ff-47fa-8d31-2f7f05de1d3a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:49.419762 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-018a1c85-d6ff-47fa-8d31-2f7f05de1d3a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:49.441582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-018a1c85-d6ff-47fa-8d31-2f7f05de1d3a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:49.441886 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-018a1c85-d6ff-47fa-8d31-2f7f05de1d3a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:49.443454 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-018a1c85-d6ff-47fa-8d31-2f7f05de1d3a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:49.443832 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-018a1c85-d6ff-47fa-8d31-2f7f05de1d3a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:49.524410 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2a11bfce-3f7a-4f32-b59f-95e0ba088251 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:49.536541 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2a11bfce-3f7a-4f32-b59f-95e0ba088251 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1319 microversion: 2.1 time: 0.320717 May 17 17:11:49.537158 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 100/215] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:49 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:49.572083 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7701caed-51a3-4d36-a829-141162315594 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:49.572822 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7701caed-51a3-4d36-a829-141162315594 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:49.581155 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7701caed-51a3-4d36-a829-141162315594 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:49.581612 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7701caed-51a3-4d36-a829-141162315594 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:49.582172 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-018a1c85-d6ff-47fa-8d31-2f7f05de1d3a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:49.583862 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7701caed-51a3-4d36-a829-141162315594 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:49.584744 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7701caed-51a3-4d36-a829-141162315594 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:49.602737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-018a1c85-d6ff-47fa-8d31-2f7f05de1d3a tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1266 microversion: 2.1 time: 0.188418 May 17 17:11:49.607771 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 116/216] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:49 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:49.647316 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-7f2b286d-b0dc-4729-b011-d02c9ff0c4aa req-ad270237-d7f9-4e20-9a7c-ada005c99f69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159a856c-1046-429c-91b8-71de1b5adc15", "tag": "902521d6-268e-414c-ae53-f1f63273ac65"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:49.656827 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-7f2b286d-b0dc-4729-b011-d02c9ff0c4aa req-ad270237-d7f9-4e20-9a7c-ada005c99f69 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:49.657410 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-7f2b286d-b0dc-4729-b011-d02c9ff0c4aa req-ad270237-d7f9-4e20-9a7c-ada005c99f69 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:49.676132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-7f2b286d-b0dc-4729-b011-d02c9ff0c4aa req-ad270237-d7f9-4e20-9a7c-ada005c99f69 service nova] Creating event network-changed:902521d6-268e-414c-ae53-f1f63273ac65 for instance 159a856c-1046-429c-91b8-71de1b5adc15 on hv-cinder-84214 May 17 17:11:49.686180 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-7f2b286d-b0dc-4729-b011-d02c9ff0c4aa req-ad270237-d7f9-4e20-9a7c-ada005c99f69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043026 May 17 17:11:49.687323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 117/217] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:11:49.705772 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-430dd775-50c3-43c8-97b8-2b48fd1ccdd1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:49.706479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-430dd775-50c3-43c8-97b8-2b48fd1ccdd1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:49.713280 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-430dd775-50c3-43c8-97b8-2b48fd1ccdd1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:49.713725 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-430dd775-50c3-43c8-97b8-2b48fd1ccdd1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:49.714525 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-430dd775-50c3-43c8-97b8-2b48fd1ccdd1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:49.714954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-430dd775-50c3-43c8-97b8-2b48fd1ccdd1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:49.814777 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7701caed-51a3-4d36-a829-141162315594 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:49.826178 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7701caed-51a3-4d36-a829-141162315594 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.260627 May 17 17:11:49.826774 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 101/218] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:49 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:49.932967 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-430dd775-50c3-43c8-97b8-2b48fd1ccdd1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:49.940402 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-430dd775-50c3-43c8-97b8-2b48fd1ccdd1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1236 microversion: 2.1 time: 0.238962 May 17 17:11:49.951151 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 118/219] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:49 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1236 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:50.553621 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1f141248-8936-42d1-903d-b91a1d38968f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:50.554360 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1f141248-8936-42d1-903d-b91a1d38968f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:50.562446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1f141248-8936-42d1-903d-b91a1d38968f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:50.563007 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1f141248-8936-42d1-903d-b91a1d38968f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:50.564396 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1f141248-8936-42d1-903d-b91a1d38968f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:50.565234 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1f141248-8936-42d1-903d-b91a1d38968f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:50.624350 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-07f4d517-4a75-4934-b914-64e110a09e99 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:50.624964 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-07f4d517-4a75-4934-b914-64e110a09e99 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:50.639694 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-07f4d517-4a75-4934-b914-64e110a09e99 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:50.640398 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-07f4d517-4a75-4934-b914-64e110a09e99 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:50.641593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-07f4d517-4a75-4934-b914-64e110a09e99 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:50.642853 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-07f4d517-4a75-4934-b914-64e110a09e99 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:50.793193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-07f4d517-4a75-4934-b914-64e110a09e99 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:50.802396 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-07f4d517-4a75-4934-b914-64e110a09e99 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1266 microversion: 2.1 time: 0.185272 May 17 17:11:50.813243 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 119/220] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:50 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:50.818964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1f141248-8936-42d1-903d-b91a1d38968f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:50.830269 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1f141248-8936-42d1-903d-b91a1d38968f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1319 microversion: 2.1 time: 0.280682 May 17 17:11:50.831903 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 102/221] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:50 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:50.844390 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ffdd5c3b-3096-4818-be7f-f0e93717d248 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:50.849737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ffdd5c3b-3096-4818-be7f-f0e93717d248 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:50.858352 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ffdd5c3b-3096-4818-be7f-f0e93717d248 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:50.858796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ffdd5c3b-3096-4818-be7f-f0e93717d248 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:50.859563 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ffdd5c3b-3096-4818-be7f-f0e93717d248 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:50.860079 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ffdd5c3b-3096-4818-be7f-f0e93717d248 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:50.958996 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ee40f1f7-bbad-4757-9fd2-a08c870fff56 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:50.959636 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ee40f1f7-bbad-4757-9fd2-a08c870fff56 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:50.966180 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ee40f1f7-bbad-4757-9fd2-a08c870fff56 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:50.966861 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ee40f1f7-bbad-4757-9fd2-a08c870fff56 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:50.967665 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ee40f1f7-bbad-4757-9fd2-a08c870fff56 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:50.968109 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ee40f1f7-bbad-4757-9fd2-a08c870fff56 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:51.018514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ffdd5c3b-3096-4818-be7f-f0e93717d248 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:51.026625 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ffdd5c3b-3096-4818-be7f-f0e93717d248 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.185982 May 17 17:11:51.027196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 120/222] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:50 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:51.037916 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ee40f1f7-bbad-4757-9fd2-a08c870fff56 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:51.046117 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ee40f1f7-bbad-4757-9fd2-a08c870fff56 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1292 microversion: 2.1 time: 0.091845 May 17 17:11:51.046871 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 103/223] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:50 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:51.820452 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c234b177-1913-4728-85fe-1413f2e800a6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:51.821161 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c234b177-1913-4728-85fe-1413f2e800a6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:51.827774 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c234b177-1913-4728-85fe-1413f2e800a6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:51.828304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c234b177-1913-4728-85fe-1413f2e800a6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:51.829135 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c234b177-1913-4728-85fe-1413f2e800a6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:51.830013 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c234b177-1913-4728-85fe-1413f2e800a6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:51.848315 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b3477298-c5e3-49c9-8d45-f6bf8cb079d8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:51.850359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-b3477298-c5e3-49c9-8d45-f6bf8cb079d8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:51.858261 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b3477298-c5e3-49c9-8d45-f6bf8cb079d8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:51.860930 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b3477298-c5e3-49c9-8d45-f6bf8cb079d8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:51.862780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b3477298-c5e3-49c9-8d45-f6bf8cb079d8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:51.864024 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b3477298-c5e3-49c9-8d45-f6bf8cb079d8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:51.904913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c234b177-1913-4728-85fe-1413f2e800a6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:51.913312 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c234b177-1913-4728-85fe-1413f2e800a6 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1272 microversion: 2.1 time: 0.097288 May 17 17:11:51.914095 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 121/224] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:51 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:52.014528 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-b3477298-c5e3-49c9-8d45-f6bf8cb079d8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:52.022851 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-b3477298-c5e3-49c9-8d45-f6bf8cb079d8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1319 microversion: 2.1 time: 0.178383 May 17 17:11:52.023416 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 104/225] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:51 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:52.044133 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f150b64c-efcf-469d-a43e-3caf3d94b612 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:52.044834 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f150b64c-efcf-469d-a43e-3caf3d94b612 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:52.050719 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f150b64c-efcf-469d-a43e-3caf3d94b612 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:52.051178 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f150b64c-efcf-469d-a43e-3caf3d94b612 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:52.052257 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f150b64c-efcf-469d-a43e-3caf3d94b612 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:52.052703 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f150b64c-efcf-469d-a43e-3caf3d94b612 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:52.063758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-68c677d5-e038-48b3-b31e-918a80fbe8e8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:52.064380 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-68c677d5-e038-48b3-b31e-918a80fbe8e8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:52.071185 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-68c677d5-e038-48b3-b31e-918a80fbe8e8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:52.071675 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-68c677d5-e038-48b3-b31e-918a80fbe8e8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:52.072459 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-68c677d5-e038-48b3-b31e-918a80fbe8e8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:52.072910 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-68c677d5-e038-48b3-b31e-918a80fbe8e8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:52.174890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-68c677d5-e038-48b3-b31e-918a80fbe8e8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:52.189347 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-68c677d5-e038-48b3-b31e-918a80fbe8e8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1298 microversion: 2.1 time: 0.129085 May 17 17:11:52.192891 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 105/226] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:52 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1298 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:52.270697 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f150b64c-efcf-469d-a43e-3caf3d94b612 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:52.278734 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f150b64c-efcf-469d-a43e-3caf3d94b612 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1522 microversion: 2.1 time: 0.238816 May 17 17:11:52.290081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 122/227] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:52 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:52.930301 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-519a36a9-fd30-43ed-8dfa-3d7dfb4b4e3f tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:52.931047 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-519a36a9-fd30-43ed-8dfa-3d7dfb4b4e3f tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:52.946403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-519a36a9-fd30-43ed-8dfa-3d7dfb4b4e3f tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:52.946885 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-519a36a9-fd30-43ed-8dfa-3d7dfb4b4e3f tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:52.947890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-519a36a9-fd30-43ed-8dfa-3d7dfb4b4e3f tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:52.948479 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-519a36a9-fd30-43ed-8dfa-3d7dfb4b4e3f tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:53.040939 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-374b43d5-a0bd-4562-a306-ee452037f241 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:53.042274 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-374b43d5-a0bd-4562-a306-ee452037f241 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:53.049802 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-374b43d5-a0bd-4562-a306-ee452037f241 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:53.050487 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-374b43d5-a0bd-4562-a306-ee452037f241 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:53.051844 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-374b43d5-a0bd-4562-a306-ee452037f241 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:53.052465 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-374b43d5-a0bd-4562-a306-ee452037f241 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:53.183970 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-519a36a9-fd30-43ed-8dfa-3d7dfb4b4e3f tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:53.203312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-519a36a9-fd30-43ed-8dfa-3d7dfb4b4e3f tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1314 microversion: 2.1 time: 0.277347 May 17 17:11:53.203939 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 106/228] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:52 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:53.210112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b1827b3e-6c1e-4a25-8df3-a6797914cc33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:53.210915 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-b1827b3e-6c1e-4a25-8df3-a6797914cc33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:53.218937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b1827b3e-6c1e-4a25-8df3-a6797914cc33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:53.224747 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b1827b3e-6c1e-4a25-8df3-a6797914cc33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:53.225786 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b1827b3e-6c1e-4a25-8df3-a6797914cc33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:53.226389 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b1827b3e-6c1e-4a25-8df3-a6797914cc33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:53.322521 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-374b43d5-a0bd-4562-a306-ee452037f241 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:53.328134 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-b1827b3e-6c1e-4a25-8df3-a6797914cc33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:53.334907 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-374b43d5-a0bd-4562-a306-ee452037f241 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1319 microversion: 2.1 time: 0.296546 May 17 17:11:53.338288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-b1827b3e-6c1e-4a25-8df3-a6797914cc33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1298 microversion: 2.1 time: 0.132877 May 17 17:11:53.338865 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 107/229] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:53 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:53.352604 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 123/230] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:53 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:53.354424 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0c4c64f2-edb3-4e79-b269-6703ec2d2d74 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:53.356463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0c4c64f2-edb3-4e79-b269-6703ec2d2d74 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:53.363352 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0c4c64f2-edb3-4e79-b269-6703ec2d2d74 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:53.363878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0c4c64f2-edb3-4e79-b269-6703ec2d2d74 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:53.365275 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0c4c64f2-edb3-4e79-b269-6703ec2d2d74 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:53.365902 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0c4c64f2-edb3-4e79-b269-6703ec2d2d74 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:53.526288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0c4c64f2-edb3-4e79-b269-6703ec2d2d74 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:53.533549 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0c4c64f2-edb3-4e79-b269-6703ec2d2d74 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1502 microversion: 2.1 time: 0.183521 May 17 17:11:53.534117 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 108/231] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:53 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:53.549492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7bc51340-9527-44c2-be59-8b40e364120f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:53.550112 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7bc51340-9527-44c2-be59-8b40e364120f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:53.556132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7bc51340-9527-44c2-be59-8b40e364120f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:53.556586 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7bc51340-9527-44c2-be59-8b40e364120f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:53.557366 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7bc51340-9527-44c2-be59-8b40e364120f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:53.557806 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7bc51340-9527-44c2-be59-8b40e364120f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:53.710347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7bc51340-9527-44c2-be59-8b40e364120f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:53.718570 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7bc51340-9527-44c2-be59-8b40e364120f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1516 microversion: 2.1 time: 0.172789 May 17 17:11:53.719642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 124/232] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:53 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:53.762459 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-047a402c-2846-4dff-9929-b867baca9d4e req-5e4c8509-bcf6-43fe-89df-7f04796e0550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f3bf001-c3b2-461b-99a8-5121b6a4a1eb", "tag": "25c3382a-593f-4660-bd67-2e4ecac6dced"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:53.781633 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-047a402c-2846-4dff-9929-b867baca9d4e req-5e4c8509-bcf6-43fe-89df-7f04796e0550 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:53.782093 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-047a402c-2846-4dff-9929-b867baca9d4e req-5e4c8509-bcf6-43fe-89df-7f04796e0550 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:53.805555 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-047a402c-2846-4dff-9929-b867baca9d4e req-5e4c8509-bcf6-43fe-89df-7f04796e0550 service nova] Creating event network-changed:25c3382a-593f-4660-bd67-2e4ecac6dced for instance 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb on hv-cinder-84214 May 17 17:11:53.811186 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-047a402c-2846-4dff-9929-b867baca9d4e req-5e4c8509-bcf6-43fe-89df-7f04796e0550 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053255 May 17 17:11:53.814053 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 109/233] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:11:54.220782 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f467f7af-f000-479b-8252-13c3cdda3375 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:54.221346 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f467f7af-f000-479b-8252-13c3cdda3375 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:54.227197 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f467f7af-f000-479b-8252-13c3cdda3375 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:54.227668 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f467f7af-f000-479b-8252-13c3cdda3375 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:54.228438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f467f7af-f000-479b-8252-13c3cdda3375 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:54.228869 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f467f7af-f000-479b-8252-13c3cdda3375 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:54.355307 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f1919deb-6bf1-456f-a1d4-ed14f121f249 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:54.356109 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f1919deb-6bf1-456f-a1d4-ed14f121f249 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:54.364049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f1919deb-6bf1-456f-a1d4-ed14f121f249 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:54.364049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f1919deb-6bf1-456f-a1d4-ed14f121f249 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:54.364049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f1919deb-6bf1-456f-a1d4-ed14f121f249 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:54.364609 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f1919deb-6bf1-456f-a1d4-ed14f121f249 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:54.381475 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f467f7af-f000-479b-8252-13c3cdda3375 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:54.389616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f467f7af-f000-479b-8252-13c3cdda3375 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1314 microversion: 2.1 time: 0.172910 May 17 17:11:54.398142 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 125/234] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:54 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:54.398142 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-de706a8a-0f69-4cbc-b68c-0883acdee491 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:54.398142 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-de706a8a-0f69-4cbc-b68c-0883acdee491 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:54.403050 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-de706a8a-0f69-4cbc-b68c-0883acdee491 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:54.403664 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-de706a8a-0f69-4cbc-b68c-0883acdee491 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:54.404734 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-de706a8a-0f69-4cbc-b68c-0883acdee491 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:54.405114 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-de706a8a-0f69-4cbc-b68c-0883acdee491 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:54.574093 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f1919deb-6bf1-456f-a1d4-ed14f121f249 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:54.581470 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f1919deb-6bf1-456f-a1d4-ed14f121f249 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1366 microversion: 2.1 time: 0.230771 May 17 17:11:54.582219 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 110/235] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:54 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:54.588396 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-de706a8a-0f69-4cbc-b68c-0883acdee491 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:54.596140 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-de706a8a-0f69-4cbc-b68c-0883acdee491 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1319 microversion: 2.1 time: 0.204691 May 17 17:11:54.596864 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 126/236] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:54 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:55.148771 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8ec35221-5a5f-4921-8e7d-1a9c4555d4da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:55.149709 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8ec35221-5a5f-4921-8e7d-1a9c4555d4da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:55.155686 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8ec35221-5a5f-4921-8e7d-1a9c4555d4da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:55.156345 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8ec35221-5a5f-4921-8e7d-1a9c4555d4da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:55.157264 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8ec35221-5a5f-4921-8e7d-1a9c4555d4da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:55.157850 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8ec35221-5a5f-4921-8e7d-1a9c4555d4da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:55.180809 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-8ec35221-5a5f-4921-8e7d-1a9c4555d4da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lazy-loading 'flavor' on Instance uuid 09d096e1-5210-41e8-ae6e-dee03652b474 {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:11:55.270777 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8ec35221-5a5f-4921-8e7d-1a9c4555d4da tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "POST /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474/action" status: 200 len: 32 microversion: 2.1 time: 0.126401 May 17 17:11:55.271474 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 111/237] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 17 17:11:55 2022] POST /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474/action => generated 32 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 17:11:55.280827 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a329d349-2da3-41be-9b76-7f79c603f31b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:55.282209 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a329d349-2da3-41be-9b76-7f79c603f31b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:55.289835 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a329d349-2da3-41be-9b76-7f79c603f31b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:55.290621 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a329d349-2da3-41be-9b76-7f79c603f31b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:55.291552 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a329d349-2da3-41be-9b76-7f79c603f31b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:55.292488 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a329d349-2da3-41be-9b76-7f79c603f31b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:55.408622 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-485e4569-700f-4041-8af8-2b412be026a3 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:55.410748 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-485e4569-700f-4041-8af8-2b412be026a3 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:55.420607 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-485e4569-700f-4041-8af8-2b412be026a3 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:55.421343 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-485e4569-700f-4041-8af8-2b412be026a3 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:55.423078 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-485e4569-700f-4041-8af8-2b412be026a3 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:55.423814 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-485e4569-700f-4041-8af8-2b412be026a3 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:55.435839 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a329d349-2da3-41be-9b76-7f79c603f31b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:55.446556 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a329d349-2da3-41be-9b76-7f79c603f31b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.169266 May 17 17:11:55.447480 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 127/238] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:55 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:55.572665 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-485e4569-700f-4041-8af8-2b412be026a3 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:55.581685 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-485e4569-700f-4041-8af8-2b412be026a3 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1314 microversion: 2.1 time: 0.177381 May 17 17:11:55.583908 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 112/239] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:55 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:55.600586 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-530fc1b9-0010-469c-a7e1-03db81c16bde tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:55.601362 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-530fc1b9-0010-469c-a7e1-03db81c16bde tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:55.608399 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-530fc1b9-0010-469c-a7e1-03db81c16bde tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:55.609150 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-530fc1b9-0010-469c-a7e1-03db81c16bde tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:55.610137 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-530fc1b9-0010-469c-a7e1-03db81c16bde tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:55.610903 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-530fc1b9-0010-469c-a7e1-03db81c16bde tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:55.614202 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ceaea17d-1136-444c-afca-c83962296267 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:55.615709 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ceaea17d-1136-444c-afca-c83962296267 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:55.622676 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ceaea17d-1136-444c-afca-c83962296267 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:55.623130 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ceaea17d-1136-444c-afca-c83962296267 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:55.623934 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ceaea17d-1136-444c-afca-c83962296267 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:55.624903 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ceaea17d-1136-444c-afca-c83962296267 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:55.890557 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-530fc1b9-0010-469c-a7e1-03db81c16bde tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:55.901499 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-530fc1b9-0010-469c-a7e1-03db81c16bde tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1366 microversion: 2.1 time: 0.305904 May 17 17:11:55.913677 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 128/240] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:55 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:55.922121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ceaea17d-1136-444c-afca-c83962296267 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:55.933972 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ceaea17d-1136-444c-afca-c83962296267 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1319 microversion: 2.1 time: 0.323734 May 17 17:11:55.935249 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 113/241] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:55 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:56.230240 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-de5b7b0b-df9d-4495-b244-30c5df0474f4 req-f31793f2-f336-4373-ac55-bf1e02d3dd22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a762b56-1a2c-4556-90cb-52de211c17a5", "tag": "1d705197-7ce1-4547-af7a-185fa88a47c8"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:56.252009 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-de5b7b0b-df9d-4495-b244-30c5df0474f4 req-f31793f2-f336-4373-ac55-bf1e02d3dd22 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:56.252727 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-de5b7b0b-df9d-4495-b244-30c5df0474f4 req-f31793f2-f336-4373-ac55-bf1e02d3dd22 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:56.273549 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-de5b7b0b-df9d-4495-b244-30c5df0474f4 req-f31793f2-f336-4373-ac55-bf1e02d3dd22 service nova] Creating event network-changed:1d705197-7ce1-4547-af7a-185fa88a47c8 for instance 0a762b56-1a2c-4556-90cb-52de211c17a5 on hv-cinder-84214 May 17 17:11:56.280294 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-de5b7b0b-df9d-4495-b244-30c5df0474f4 req-f31793f2-f336-4373-ac55-bf1e02d3dd22 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055768 May 17 17:11:56.281712 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 129/242] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:11:56.464073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8d9c61ea-6f4b-4350-a48c-677988dc7821 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:56.465870 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8d9c61ea-6f4b-4350-a48c-677988dc7821 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:56.471144 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8d9c61ea-6f4b-4350-a48c-677988dc7821 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:56.471623 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8d9c61ea-6f4b-4350-a48c-677988dc7821 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:56.472432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8d9c61ea-6f4b-4350-a48c-677988dc7821 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:56.472871 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8d9c61ea-6f4b-4350-a48c-677988dc7821 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:56.603399 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-0901642b-64f9-4c4f-9632-546c83920365 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:56.604559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-0901642b-64f9-4c4f-9632-546c83920365 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:56.611920 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0901642b-64f9-4c4f-9632-546c83920365 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:56.612598 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0901642b-64f9-4c4f-9632-546c83920365 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:56.613532 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0901642b-64f9-4c4f-9632-546c83920365 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:56.614918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0901642b-64f9-4c4f-9632-546c83920365 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:56.626700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-8d9c61ea-6f4b-4350-a48c-677988dc7821 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:56.634531 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8d9c61ea-6f4b-4350-a48c-677988dc7821 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.174336 May 17 17:11:56.635442 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 114/243] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:56 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:56.781593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-0901642b-64f9-4c4f-9632-546c83920365 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:56.792823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-0901642b-64f9-4c4f-9632-546c83920365 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1314 microversion: 2.1 time: 0.193744 May 17 17:11:56.802868 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 130/244] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:56 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:56.920541 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a9b1dc2f-e242-47ad-ad83-97876215e491 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:56.921145 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a9b1dc2f-e242-47ad-ad83-97876215e491 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:56.927587 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9b1dc2f-e242-47ad-ad83-97876215e491 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:56.928075 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9b1dc2f-e242-47ad-ad83-97876215e491 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:56.928832 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9b1dc2f-e242-47ad-ad83-97876215e491 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:56.929264 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9b1dc2f-e242-47ad-ad83-97876215e491 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:56.952113 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8741c4e6-127a-499e-bebf-62f9eda1f894 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:56.952802 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8741c4e6-127a-499e-bebf-62f9eda1f894 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:56.959872 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8741c4e6-127a-499e-bebf-62f9eda1f894 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:56.960399 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8741c4e6-127a-499e-bebf-62f9eda1f894 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:56.961313 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8741c4e6-127a-499e-bebf-62f9eda1f894 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:56.962884 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8741c4e6-127a-499e-bebf-62f9eda1f894 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:57.161891 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a9b1dc2f-e242-47ad-ad83-97876215e491 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:57.172187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a9b1dc2f-e242-47ad-ad83-97876215e491 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1366 microversion: 2.1 time: 0.255257 May 17 17:11:57.179034 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 115/245] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:56 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:57.187562 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8741c4e6-127a-499e-bebf-62f9eda1f894 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:57.195829 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8741c4e6-127a-499e-bebf-62f9eda1f894 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1319 microversion: 2.1 time: 0.247723 May 17 17:11:57.196405 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 131/246] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:56 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:57.651568 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2a714805-4375-44d3-9b6b-da1ab396c36a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:57.652221 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2a714805-4375-44d3-9b6b-da1ab396c36a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:57.658323 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2a714805-4375-44d3-9b6b-da1ab396c36a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:57.658962 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2a714805-4375-44d3-9b6b-da1ab396c36a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:57.659918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2a714805-4375-44d3-9b6b-da1ab396c36a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:57.660359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2a714805-4375-44d3-9b6b-da1ab396c36a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:57.795470 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2a714805-4375-44d3-9b6b-da1ab396c36a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:57.804077 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2a714805-4375-44d3-9b6b-da1ab396c36a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.156089 May 17 17:11:57.811639 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 116/247] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:57 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:57.811807 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-69ca13e5-9101-4635-a56c-be7b5e7149ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:57.811807 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-69ca13e5-9101-4635-a56c-be7b5e7149ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:57.816857 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-69ca13e5-9101-4635-a56c-be7b5e7149ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:57.817915 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-69ca13e5-9101-4635-a56c-be7b5e7149ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:57.819199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-69ca13e5-9101-4635-a56c-be7b5e7149ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:57.819199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-69ca13e5-9101-4635-a56c-be7b5e7149ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:57.947193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-69ca13e5-9101-4635-a56c-be7b5e7149ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:57.954674 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-69ca13e5-9101-4635-a56c-be7b5e7149ad tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1314 microversion: 2.1 time: 0.148325 May 17 17:11:57.955249 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 132/248] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:57 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:58.189199 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-df322e8b-b447-4219-9311-a09e61167637 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:58.189949 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-df322e8b-b447-4219-9311-a09e61167637 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:58.196758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df322e8b-b447-4219-9311-a09e61167637 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:58.197203 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df322e8b-b447-4219-9311-a09e61167637 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:58.197966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df322e8b-b447-4219-9311-a09e61167637 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:58.198396 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df322e8b-b447-4219-9311-a09e61167637 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:58.213859 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1f2a1aac-3595-4ec0-86a1-50c64451819e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:58.214474 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1f2a1aac-3595-4ec0-86a1-50c64451819e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:58.220288 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f2a1aac-3595-4ec0-86a1-50c64451819e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:58.220735 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f2a1aac-3595-4ec0-86a1-50c64451819e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:58.221500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f2a1aac-3595-4ec0-86a1-50c64451819e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:58.221931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f2a1aac-3595-4ec0-86a1-50c64451819e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:58.400131 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-df322e8b-b447-4219-9311-a09e61167637 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:58.406933 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1f2a1aac-3595-4ec0-86a1-50c64451819e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:58.407749 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-df322e8b-b447-4219-9311-a09e61167637 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1366 microversion: 2.1 time: 0.222356 May 17 17:11:58.408329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 117/249] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:58 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:58.414929 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1f2a1aac-3595-4ec0-86a1-50c64451819e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1319 microversion: 2.1 time: 0.204880 May 17 17:11:58.415586 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 133/250] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:58 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:11:58.821711 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e4007114-6cd7-438a-8edb-39e909466a9a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:58.822374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e4007114-6cd7-438a-8edb-39e909466a9a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:58.829228 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e4007114-6cd7-438a-8edb-39e909466a9a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:58.829683 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e4007114-6cd7-438a-8edb-39e909466a9a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:58.830477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e4007114-6cd7-438a-8edb-39e909466a9a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:58.831049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e4007114-6cd7-438a-8edb-39e909466a9a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:58.925688 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-a1f1390d-40e4-4a16-ac37-90d412edaa5b req-d996c421-72b0-4dd9-80b5-284b7bbb8baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159a856c-1046-429c-91b8-71de1b5adc15", "name": "network-vif-plugged", "status": "completed", "tag": "902521d6-268e-414c-ae53-f1f63273ac65"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:11:58.936095 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-a1f1390d-40e4-4a16-ac37-90d412edaa5b req-d996c421-72b0-4dd9-80b5-284b7bbb8baa service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:58.936258 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-a1f1390d-40e4-4a16-ac37-90d412edaa5b req-d996c421-72b0-4dd9-80b5-284b7bbb8baa service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:58.967855 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-a1f1390d-40e4-4a16-ac37-90d412edaa5b req-d996c421-72b0-4dd9-80b5-284b7bbb8baa service nova] Creating event network-vif-plugged:902521d6-268e-414c-ae53-f1f63273ac65 for instance 159a856c-1046-429c-91b8-71de1b5adc15 on hv-cinder-84214 May 17 17:11:58.982993 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-a1f1390d-40e4-4a16-ac37-90d412edaa5b req-d996c421-72b0-4dd9-80b5-284b7bbb8baa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060134 May 17 17:11:58.984663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 134/251] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:11:58.993855 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-66b02688-9270-4675-8e77-f01c6899ab66 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:58.994560 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-66b02688-9270-4675-8e77-f01c6899ab66 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:59.005622 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-66b02688-9270-4675-8e77-f01c6899ab66 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:59.006247 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-66b02688-9270-4675-8e77-f01c6899ab66 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:59.007287 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-66b02688-9270-4675-8e77-f01c6899ab66 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:59.007639 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-66b02688-9270-4675-8e77-f01c6899ab66 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:59.128123 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e4007114-6cd7-438a-8edb-39e909466a9a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:59.138415 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e4007114-6cd7-438a-8edb-39e909466a9a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.321473 May 17 17:11:59.139703 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 118/252] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:58 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:59.218994 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-66b02688-9270-4675-8e77-f01c6899ab66 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:59.226501 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-66b02688-9270-4675-8e77-f01c6899ab66 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1314 microversion: 2.1 time: 0.240370 May 17 17:11:59.227067 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 135/253] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:58 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:59.433186 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-bb155ae5-e319-4aed-ac1c-eb1972219a6a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:59.434069 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-44862e37-a6df-49e2-a140-892b0a6426b8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:11:59.434919 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-bb155ae5-e319-4aed-ac1c-eb1972219a6a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:59.435746 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-44862e37-a6df-49e2-a140-892b0a6426b8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:11:59.444805 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bb155ae5-e319-4aed-ac1c-eb1972219a6a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:59.445339 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bb155ae5-e319-4aed-ac1c-eb1972219a6a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:59.446182 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bb155ae5-e319-4aed-ac1c-eb1972219a6a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:59.446871 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bb155ae5-e319-4aed-ac1c-eb1972219a6a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:59.447941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-44862e37-a6df-49e2-a140-892b0a6426b8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:59.448597 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-44862e37-a6df-49e2-a140-892b0a6426b8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:59.449545 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-44862e37-a6df-49e2-a140-892b0a6426b8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:11:59.450200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-44862e37-a6df-49e2-a140-892b0a6426b8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:11:59.648273 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-44862e37-a6df-49e2-a140-892b0a6426b8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:59.650587 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-bb155ae5-e319-4aed-ac1c-eb1972219a6a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:11:59.655921 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-44862e37-a6df-49e2-a140-892b0a6426b8 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1366 microversion: 2.1 time: 0.234483 May 17 17:11:59.656607 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 119/254] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:59 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:11:59.665094 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-bb155ae5-e319-4aed-ac1c-eb1972219a6a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1319 microversion: 2.1 time: 0.235787 May 17 17:11:59.665669 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 136/255] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:11:59 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:00.155481 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0193832b-60fc-41f4-b808-49da43c5ef7f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:00.156239 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0193832b-60fc-41f4-b808-49da43c5ef7f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:00.162952 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0193832b-60fc-41f4-b808-49da43c5ef7f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:00.163752 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0193832b-60fc-41f4-b808-49da43c5ef7f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:00.164723 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0193832b-60fc-41f4-b808-49da43c5ef7f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:00.165236 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0193832b-60fc-41f4-b808-49da43c5ef7f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:00.243531 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-098eedb4-91af-4512-9c31-d939a2c2552c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:00.244632 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-098eedb4-91af-4512-9c31-d939a2c2552c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:00.251963 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-098eedb4-91af-4512-9c31-d939a2c2552c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:00.252784 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-098eedb4-91af-4512-9c31-d939a2c2552c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:00.253863 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-098eedb4-91af-4512-9c31-d939a2c2552c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:00.255031 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-098eedb4-91af-4512-9c31-d939a2c2552c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:00.326039 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0193832b-60fc-41f4-b808-49da43c5ef7f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:00.339003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0193832b-60fc-41f4-b808-49da43c5ef7f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.187091 May 17 17:12:00.339635 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 120/256] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:00 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:00.418814 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-098eedb4-91af-4512-9c31-d939a2c2552c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:00.426280 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-098eedb4-91af-4512-9c31-d939a2c2552c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1314 microversion: 2.1 time: 0.186847 May 17 17:12:00.427051 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 137/257] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:00 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:00.677054 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-654ade65-fa2f-4809-aa6c-7d72708aa635 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:00.678316 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-654ade65-fa2f-4809-aa6c-7d72708aa635 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:00.682705 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c97b40fb-2f3f-4b34-8eee-a6b3132a5292 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:00.683678 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c97b40fb-2f3f-4b34-8eee-a6b3132a5292 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:00.688160 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-654ade65-fa2f-4809-aa6c-7d72708aa635 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:00.689043 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-654ade65-fa2f-4809-aa6c-7d72708aa635 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:00.690121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-654ade65-fa2f-4809-aa6c-7d72708aa635 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:00.690523 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c97b40fb-2f3f-4b34-8eee-a6b3132a5292 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:00.690985 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c97b40fb-2f3f-4b34-8eee-a6b3132a5292 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:00.691188 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-654ade65-fa2f-4809-aa6c-7d72708aa635 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:00.691912 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c97b40fb-2f3f-4b34-8eee-a6b3132a5292 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:00.692258 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c97b40fb-2f3f-4b34-8eee-a6b3132a5292 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:00.898140 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c97b40fb-2f3f-4b34-8eee-a6b3132a5292 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:00.901134 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-654ade65-fa2f-4809-aa6c-7d72708aa635 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:00.908528 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c97b40fb-2f3f-4b34-8eee-a6b3132a5292 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1319 microversion: 2.1 time: 0.230092 May 17 17:12:00.909292 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 138/258] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:00 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:00.918599 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-654ade65-fa2f-4809-aa6c-7d72708aa635 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1366 microversion: 2.1 time: 0.241543 May 17 17:12:00.922305 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 121/259] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:00 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:01.032879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-2fda4c55-d537-4c7e-987b-176f4cf218e5 req-be25e228-fb48-4e1c-a0c9-be31368fbc6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3bf001-c3b2-461b-99a8-5121b6a4a1eb", "name": "network-vif-plugged", "status": "completed", "tag": "25c3382a-593f-4660-bd67-2e4ecac6dced"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:01.044121 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-2fda4c55-d537-4c7e-987b-176f4cf218e5 req-be25e228-fb48-4e1c-a0c9-be31368fbc6c service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:01.044759 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-2fda4c55-d537-4c7e-987b-176f4cf218e5 req-be25e228-fb48-4e1c-a0c9-be31368fbc6c service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:01.057247 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-2fda4c55-d537-4c7e-987b-176f4cf218e5 req-be25e228-fb48-4e1c-a0c9-be31368fbc6c service nova] Creating event network-vif-plugged:25c3382a-593f-4660-bd67-2e4ecac6dced for instance 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb on hv-cinder-84214 May 17 17:12:01.062145 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-2fda4c55-d537-4c7e-987b-176f4cf218e5 req-be25e228-fb48-4e1c-a0c9-be31368fbc6c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032808 May 17 17:12:01.062686 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 139/260] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:01.356226 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-415640f7-0207-4d8e-8bc0-288be8534a70 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:01.356860 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-415640f7-0207-4d8e-8bc0-288be8534a70 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:01.364106 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-415640f7-0207-4d8e-8bc0-288be8534a70 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:01.364795 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-415640f7-0207-4d8e-8bc0-288be8534a70 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:01.365768 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-415640f7-0207-4d8e-8bc0-288be8534a70 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:01.366344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-415640f7-0207-4d8e-8bc0-288be8534a70 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:01.443801 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d7f402cc-6555-41b2-8c7d-f76d7568e129 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:01.445089 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d7f402cc-6555-41b2-8c7d-f76d7568e129 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:01.451571 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d7f402cc-6555-41b2-8c7d-f76d7568e129 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:01.452320 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d7f402cc-6555-41b2-8c7d-f76d7568e129 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:01.466312 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d7f402cc-6555-41b2-8c7d-f76d7568e129 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:01.475875 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d7f402cc-6555-41b2-8c7d-f76d7568e129 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:01.513667 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-415640f7-0207-4d8e-8bc0-288be8534a70 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:01.522654 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-415640f7-0207-4d8e-8bc0-288be8534a70 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.170042 May 17 17:12:01.523850 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 122/261] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:01 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:01.620720 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d7f402cc-6555-41b2-8c7d-f76d7568e129 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:01.627957 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d7f402cc-6555-41b2-8c7d-f76d7568e129 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1314 microversion: 2.1 time: 0.189439 May 17 17:12:01.628518 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 140/262] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:01 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:01.925096 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-df2a55be-5482-4bc4-8d68-f7685cba0b6f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:01.925854 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-df2a55be-5482-4bc4-8d68-f7685cba0b6f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:01.929595 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-34e2f419-8aae-4504-a96a-9d9bdfda1101 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:01.930408 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-34e2f419-8aae-4504-a96a-9d9bdfda1101 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:01.932359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df2a55be-5482-4bc4-8d68-f7685cba0b6f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:01.932890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df2a55be-5482-4bc4-8d68-f7685cba0b6f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:01.933750 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df2a55be-5482-4bc4-8d68-f7685cba0b6f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:01.934278 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-df2a55be-5482-4bc4-8d68-f7685cba0b6f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:01.936731 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-34e2f419-8aae-4504-a96a-9d9bdfda1101 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:01.937583 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-34e2f419-8aae-4504-a96a-9d9bdfda1101 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:01.939702 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-34e2f419-8aae-4504-a96a-9d9bdfda1101 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:01.939702 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-34e2f419-8aae-4504-a96a-9d9bdfda1101 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:02.127499 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-df2a55be-5482-4bc4-8d68-f7685cba0b6f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:02.131306 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-34e2f419-8aae-4504-a96a-9d9bdfda1101 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:02.138716 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-df2a55be-5482-4bc4-8d68-f7685cba0b6f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1507 microversion: 2.1 time: 0.217321 May 17 17:12:02.144617 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 123/263] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:01 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:02.145138 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-34e2f419-8aae-4504-a96a-9d9bdfda1101 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1366 microversion: 2.1 time: 0.214174 May 17 17:12:02.145138 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 141/264] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:01 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:02.544705 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-79fd3817-83eb-4dde-818a-5fe5e773fb1b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:02.546034 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-79fd3817-83eb-4dde-818a-5fe5e773fb1b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:02.554919 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-79fd3817-83eb-4dde-818a-5fe5e773fb1b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:02.555555 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-79fd3817-83eb-4dde-818a-5fe5e773fb1b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:02.556697 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-79fd3817-83eb-4dde-818a-5fe5e773fb1b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:02.557292 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-79fd3817-83eb-4dde-818a-5fe5e773fb1b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:02.658925 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3b46850b-46bd-4811-8379-8c3ce9d47455 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:02.662135 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-3b46850b-46bd-4811-8379-8c3ce9d47455 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:02.674700 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3b46850b-46bd-4811-8379-8c3ce9d47455 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:02.680481 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3b46850b-46bd-4811-8379-8c3ce9d47455 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:02.685645 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3b46850b-46bd-4811-8379-8c3ce9d47455 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:02.686388 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3b46850b-46bd-4811-8379-8c3ce9d47455 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:02.824284 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-79fd3817-83eb-4dde-818a-5fe5e773fb1b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:02.836423 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-79fd3817-83eb-4dde-818a-5fe5e773fb1b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.300917 May 17 17:12:02.847130 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 124/265] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:02 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:02.937534 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-3b46850b-46bd-4811-8379-8c3ce9d47455 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:02.950218 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-3b46850b-46bd-4811-8379-8c3ce9d47455 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1314 microversion: 2.1 time: 0.297897 May 17 17:12:02.961933 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 142/266] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:02 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:03.079834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-a12203ed-2f3d-4d16-bc55-37e053d40336 req-36155aeb-a06d-41e8-a602-045755511755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a762b56-1a2c-4556-90cb-52de211c17a5", "name": "network-vif-plugged", "status": "completed", "tag": "1d705197-7ce1-4547-af7a-185fa88a47c8"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:03.089474 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-a12203ed-2f3d-4d16-bc55-37e053d40336 req-36155aeb-a06d-41e8-a602-045755511755 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:03.090135 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-a12203ed-2f3d-4d16-bc55-37e053d40336 req-36155aeb-a06d-41e8-a602-045755511755 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:03.103550 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-a12203ed-2f3d-4d16-bc55-37e053d40336 req-36155aeb-a06d-41e8-a602-045755511755 service nova] Creating event network-vif-plugged:1d705197-7ce1-4547-af7a-185fa88a47c8 for instance 0a762b56-1a2c-4556-90cb-52de211c17a5 on hv-cinder-84214 May 17 17:12:03.112141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-a12203ed-2f3d-4d16-bc55-37e053d40336 req-36155aeb-a06d-41e8-a602-045755511755 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033350 May 17 17:12:03.112832 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 125/267] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:03.157351 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9d809539-ab8b-4238-bdaf-c3c322c17954 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:03.158922 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9d809539-ab8b-4238-bdaf-c3c322c17954 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:03.167430 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9d809539-ab8b-4238-bdaf-c3c322c17954 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:03.171255 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9d809539-ab8b-4238-bdaf-c3c322c17954 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:03.172138 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9d809539-ab8b-4238-bdaf-c3c322c17954 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:03.172584 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9d809539-ab8b-4238-bdaf-c3c322c17954 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:03.359700 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9d809539-ab8b-4238-bdaf-c3c322c17954 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:03.370712 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9d809539-ab8b-4238-bdaf-c3c322c17954 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1366 microversion: 2.1 time: 0.217112 May 17 17:12:03.371648 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 143/268] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:03 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:03.855564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a016dd8c-259d-4fe3-bbc2-91c2253fb219 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:03.856076 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a016dd8c-259d-4fe3-bbc2-91c2253fb219 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:03.868447 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a016dd8c-259d-4fe3-bbc2-91c2253fb219 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:03.868922 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a016dd8c-259d-4fe3-bbc2-91c2253fb219 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:03.869753 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a016dd8c-259d-4fe3-bbc2-91c2253fb219 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:03.870186 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a016dd8c-259d-4fe3-bbc2-91c2253fb219 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:03.970293 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-56988814-82f6-4195-ae42-a35881398a47 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:03.971026 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-56988814-82f6-4195-ae42-a35881398a47 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:03.979806 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-56988814-82f6-4195-ae42-a35881398a47 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:03.980384 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-56988814-82f6-4195-ae42-a35881398a47 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:03.982336 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-56988814-82f6-4195-ae42-a35881398a47 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:03.982997 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-56988814-82f6-4195-ae42-a35881398a47 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:04.073233 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a016dd8c-259d-4fe3-bbc2-91c2253fb219 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:04.091659 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a016dd8c-259d-4fe3-bbc2-91c2253fb219 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.240329 May 17 17:12:04.092719 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 126/269] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:03 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:04.149744 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-56988814-82f6-4195-ae42-a35881398a47 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:04.158704 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-56988814-82f6-4195-ae42-a35881398a47 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1498 microversion: 2.1 time: 0.193846 May 17 17:12:04.159320 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 144/270] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:03 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1498 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:04.388730 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9153e1c0-17cf-4859-b083-5aeb3aa52f26 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:04.389333 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9153e1c0-17cf-4859-b083-5aeb3aa52f26 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:04.396242 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9153e1c0-17cf-4859-b083-5aeb3aa52f26 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:04.396632 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9153e1c0-17cf-4859-b083-5aeb3aa52f26 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:04.397422 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9153e1c0-17cf-4859-b083-5aeb3aa52f26 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:04.397857 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9153e1c0-17cf-4859-b083-5aeb3aa52f26 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:04.527554 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9153e1c0-17cf-4859-b083-5aeb3aa52f26 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:04.536537 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9153e1c0-17cf-4859-b083-5aeb3aa52f26 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1366 microversion: 2.1 time: 0.151579 May 17 17:12:04.537367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 127/271] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:04 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:05.041287 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7d6c003c-2b07-4b97-99be-b7ab7dadc818 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:05.041836 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7d6c003c-2b07-4b97-99be-b7ab7dadc818 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:05.048107 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7d6c003c-2b07-4b97-99be-b7ab7dadc818 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:05.048555 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7d6c003c-2b07-4b97-99be-b7ab7dadc818 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:05.049337 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7d6c003c-2b07-4b97-99be-b7ab7dadc818 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:05.049764 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7d6c003c-2b07-4b97-99be-b7ab7dadc818 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:05.077129 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7d6c003c-2b07-4b97-99be-b7ab7dadc818 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Going to try to terminate instance {{(pid=117090) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:12:05.110124 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e8be588c-7a9e-411a-a1b4-6500374f5e66 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:05.110847 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e8be588c-7a9e-411a-a1b4-6500374f5e66 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:05.119222 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e8be588c-7a9e-411a-a1b4-6500374f5e66 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:05.119703 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e8be588c-7a9e-411a-a1b4-6500374f5e66 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:05.120763 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e8be588c-7a9e-411a-a1b4-6500374f5e66 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:05.121240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e8be588c-7a9e-411a-a1b4-6500374f5e66 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:05.172823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7d6c003c-2b07-4b97-99be-b7ab7dadc818 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 204 len: 0 microversion: 2.1 time: 0.135290 May 17 17:12:05.177831 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 145/272] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:12:05 2022] DELETE /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:12:05.185983 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-67b050a8-63a8-4103-9890-81356e5c5a0c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:05.187130 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-67b050a8-63a8-4103-9890-81356e5c5a0c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:05.205847 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-67b050a8-63a8-4103-9890-81356e5c5a0c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:05.206595 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-67b050a8-63a8-4103-9890-81356e5c5a0c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:05.208174 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-67b050a8-63a8-4103-9890-81356e5c5a0c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:05.208599 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-67b050a8-63a8-4103-9890-81356e5c5a0c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:05.346119 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e8be588c-7a9e-411a-a1b4-6500374f5e66 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:05.355029 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e8be588c-7a9e-411a-a1b4-6500374f5e66 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.248621 May 17 17:12:05.355717 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 128/273] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:05 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:05.360887 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-21022555", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452"}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:05.389132 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-67b050a8-63a8-4103-9890-81356e5c5a0c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:05.399124 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-67b050a8-63a8-4103-9890-81356e5c5a0c tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1504 microversion: 2.1 time: 0.219387 May 17 17:12:05.399854 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 146/274] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:05 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:05.411487 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] validate_networks() for None {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:12:05.554240 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f6d5e80d-c7dd-4957-8fb4-f51feb89100d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:05.554864 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f6d5e80d-c7dd-4957-8fb4-f51feb89100d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:05.560995 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f6d5e80d-c7dd-4957-8fb4-f51feb89100d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:05.561448 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f6d5e80d-c7dd-4957-8fb4-f51feb89100d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:05.562235 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f6d5e80d-c7dd-4957-8fb4-f51feb89100d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:05.562674 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f6d5e80d-c7dd-4957-8fb4-f51feb89100d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:05.918748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f6d5e80d-c7dd-4957-8fb4-f51feb89100d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:05.926760 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f6d5e80d-c7dd-4957-8fb4-f51feb89100d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1556 microversion: 2.1 time: 0.377130 May 17 17:12:05.927334 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 147/275] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:05 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1556 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:05.937957 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:12:05.938384 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:12:05.938849 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:12:05.939256 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:12:05.939691 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:12:05.943595 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1aeb0d92-f741-47a6-b832-59dbb86d7069 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:05.944142 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1aeb0d92-f741-47a6-b832-59dbb86d7069 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:05.949433 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:05.949890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:05.950035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1aeb0d92-f741-47a6-b832-59dbb86d7069 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:05.950479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1aeb0d92-f741-47a6-b832-59dbb86d7069 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:05.950702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:05.951147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:05.951250 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1aeb0d92-f741-47a6-b832-59dbb86d7069 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:05.951680 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1aeb0d92-f741-47a6-b832-59dbb86d7069 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:05.967527 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Getting quotas for project d440db1af37449b1a5d268506dc5bf11. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:12:05.971522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Getting quotas for user c7e15f0e588042df9a7502c9f8d50479 and project d440db1af37449b1a5d268506dc5bf11. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:12:05.983201 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:12:05.985661 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:12:06.030313 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1aeb0d92-f741-47a6-b832-59dbb86d7069 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091099 May 17 17:12:06.031038 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 148/276] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 17 17:12:05 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:06.033918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8656a74d-0f41-4660-9557-514b6895a6be tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676749 May 17 17:12:06.034710 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 129/277] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:12:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:12:06.044580 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d193c3be-5592-4ce3-ac72-be373feaecc6 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:06.045186 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d193c3be-5592-4ce3-ac72-be373feaecc6 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:06.145029 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d193c3be-5592-4ce3-ac72-be373feaecc6 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:06.151667 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d193c3be-5592-4ce3-ac72-be373feaecc6 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1213 microversion: 2.1 time: 0.110955 May 17 17:12:06.152664 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 149/278] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:06 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:06.374528 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f6c3ec2c-ed7b-4ef8-b9e7-cb9a9fa54a87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:06.376782 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f6c3ec2c-ed7b-4ef8-b9e7-cb9a9fa54a87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:06.387581 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f6c3ec2c-ed7b-4ef8-b9e7-cb9a9fa54a87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:06.389134 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f6c3ec2c-ed7b-4ef8-b9e7-cb9a9fa54a87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:06.391232 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f6c3ec2c-ed7b-4ef8-b9e7-cb9a9fa54a87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:06.393550 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f6c3ec2c-ed7b-4ef8-b9e7-cb9a9fa54a87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:06.416094 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-485a5a8d-2b19-4708-80cb-b565958f7ab5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:06.416703 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-485a5a8d-2b19-4708-80cb-b565958f7ab5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:06.423415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-485a5a8d-2b19-4708-80cb-b565958f7ab5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:06.424058 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-485a5a8d-2b19-4708-80cb-b565958f7ab5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:06.424899 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-485a5a8d-2b19-4708-80cb-b565958f7ab5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:06.425357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-485a5a8d-2b19-4708-80cb-b565958f7ab5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:06.726390 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f6c3ec2c-ed7b-4ef8-b9e7-cb9a9fa54a87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:06.733856 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f6c3ec2c-ed7b-4ef8-b9e7-cb9a9fa54a87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.365173 May 17 17:12:06.734536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 130/279] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:06 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:06.735923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-485a5a8d-2b19-4708-80cb-b565958f7ab5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:06.743982 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-485a5a8d-2b19-4708-80cb-b565958f7ab5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1504 microversion: 2.1 time: 0.331894 May 17 17:12:06.744688 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 150/280] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:06 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:07.170232 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8f4e26b6-f295-45c5-bff7-ba2492251d7a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:07.170232 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8f4e26b6-f295-45c5-bff7-ba2492251d7a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:07.182867 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8f4e26b6-f295-45c5-bff7-ba2492251d7a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:07.183322 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8f4e26b6-f295-45c5-bff7-ba2492251d7a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:07.184138 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8f4e26b6-f295-45c5-bff7-ba2492251d7a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:07.184585 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8f4e26b6-f295-45c5-bff7-ba2492251d7a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:07.198761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-f4c4940e-97f1-4ea7-aa3e-ea32246e7c49 req-38f88bae-aac1-45ad-aa27-1e5608a74636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a762b56-1a2c-4556-90cb-52de211c17a5", "tag": "1d705197-7ce1-4547-af7a-185fa88a47c8"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:07.206937 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-f4c4940e-97f1-4ea7-aa3e-ea32246e7c49 req-38f88bae-aac1-45ad-aa27-1e5608a74636 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:07.207501 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-f4c4940e-97f1-4ea7-aa3e-ea32246e7c49 req-38f88bae-aac1-45ad-aa27-1e5608a74636 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:07.218589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-f4c4940e-97f1-4ea7-aa3e-ea32246e7c49 req-38f88bae-aac1-45ad-aa27-1e5608a74636 service nova] Creating event network-changed:1d705197-7ce1-4547-af7a-185fa88a47c8 for instance 0a762b56-1a2c-4556-90cb-52de211c17a5 on hv-cinder-84214 May 17 17:12:07.224947 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-f4c4940e-97f1-4ea7-aa3e-ea32246e7c49 req-38f88bae-aac1-45ad-aa27-1e5608a74636 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029751 May 17 17:12:07.226129 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 151/281] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:07.252813 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-8f4e26b6-f295-45c5-bff7-ba2492251d7a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:07.260788 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8f4e26b6-f295-45c5-bff7-ba2492251d7a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1217 microversion: 2.1 time: 0.095063 May 17 17:12:07.261672 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 131/282] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:07 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:07.752376 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3521b62b-fcd4-46a1-b6fe-cc2ddc154658 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:07.752982 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-3521b62b-fcd4-46a1-b6fe-cc2ddc154658 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:07.760635 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3521b62b-fcd4-46a1-b6fe-cc2ddc154658 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:07.761351 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3521b62b-fcd4-46a1-b6fe-cc2ddc154658 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:07.761918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1c36de99-7b8e-4e7e-b4ab-8ffdfa32b2f0 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:07.762808 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3521b62b-fcd4-46a1-b6fe-cc2ddc154658 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:07.763000 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1c36de99-7b8e-4e7e-b4ab-8ffdfa32b2f0 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:07.763554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3521b62b-fcd4-46a1-b6fe-cc2ddc154658 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:07.774389 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1c36de99-7b8e-4e7e-b4ab-8ffdfa32b2f0 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:07.776217 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1c36de99-7b8e-4e7e-b4ab-8ffdfa32b2f0 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:07.777214 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1c36de99-7b8e-4e7e-b4ab-8ffdfa32b2f0 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:07.777812 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1c36de99-7b8e-4e7e-b4ab-8ffdfa32b2f0 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:08.087342 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1c36de99-7b8e-4e7e-b4ab-8ffdfa32b2f0 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:08.098322 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1c36de99-7b8e-4e7e-b4ab-8ffdfa32b2f0 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1504 microversion: 2.1 time: 0.341036 May 17 17:12:08.109825 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 132/283] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:07 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:08.135967 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-3521b62b-fcd4-46a1-b6fe-cc2ddc154658 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:08.146626 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-3521b62b-fcd4-46a1-b6fe-cc2ddc154658 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.398458 May 17 17:12:08.147913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 152/284] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:07 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:08.289048 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e6ee203e-3c77-4eea-a223-42104de54c2f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:08.290020 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e6ee203e-3c77-4eea-a223-42104de54c2f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:08.306021 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e6ee203e-3c77-4eea-a223-42104de54c2f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:08.308317 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e6ee203e-3c77-4eea-a223-42104de54c2f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:08.309133 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e6ee203e-3c77-4eea-a223-42104de54c2f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:08.309574 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e6ee203e-3c77-4eea-a223-42104de54c2f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:08.398213 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e6ee203e-3c77-4eea-a223-42104de54c2f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:08.405693 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e6ee203e-3c77-4eea-a223-42104de54c2f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1265 microversion: 2.1 time: 0.131096 May 17 17:12:08.406723 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 133/285] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:08 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1265 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:09.050943 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-3fe4afe0-289b-4d01-a62f-027f4d95d7cf req-96ce1d1e-6358-4c8d-a766-d870314564d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3bf001-c3b2-461b-99a8-5121b6a4a1eb", "name": "network-vif-deleted", "tag": "25c3382a-593f-4660-bd67-2e4ecac6dced"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:09.060633 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-3fe4afe0-289b-4d01-a62f-027f4d95d7cf req-96ce1d1e-6358-4c8d-a766-d870314564d5 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:09.061468 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-3fe4afe0-289b-4d01-a62f-027f4d95d7cf req-96ce1d1e-6358-4c8d-a766-d870314564d5 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:09.074463 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-3fe4afe0-289b-4d01-a62f-027f4d95d7cf req-96ce1d1e-6358-4c8d-a766-d870314564d5 service nova] Creating event network-vif-deleted:25c3382a-593f-4660-bd67-2e4ecac6dced for instance 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb on hv-cinder-84214 May 17 17:12:09.079350 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-3fe4afe0-289b-4d01-a62f-027f4d95d7cf req-96ce1d1e-6358-4c8d-a766-d870314564d5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032492 May 17 17:12:09.080242 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 153/286] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:09.116693 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f0256899-ffda-4682-b022-000eed64b5c5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:09.117345 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f0256899-ffda-4682-b022-000eed64b5c5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:09.132677 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f0256899-ffda-4682-b022-000eed64b5c5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:09.133134 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f0256899-ffda-4682-b022-000eed64b5c5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:09.133955 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f0256899-ffda-4682-b022-000eed64b5c5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:09.134646 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f0256899-ffda-4682-b022-000eed64b5c5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:09.166584 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-93f58fe2-38f5-41e5-ae7b-1f5a986d32de tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:09.167330 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-93f58fe2-38f5-41e5-ae7b-1f5a986d32de tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:09.177789 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-93f58fe2-38f5-41e5-ae7b-1f5a986d32de tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:09.178249 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-93f58fe2-38f5-41e5-ae7b-1f5a986d32de tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:09.179075 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-93f58fe2-38f5-41e5-ae7b-1f5a986d32de tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:09.179748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-93f58fe2-38f5-41e5-ae7b-1f5a986d32de tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:09.271011 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f0256899-ffda-4682-b022-000eed64b5c5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3feefbd066d49148171c392838b4e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5858756d2b74673a765c1d2e6adf280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:09.283828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f0256899-ffda-4682-b022-000eed64b5c5 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 200 len: 1299 microversion: 2.1 time: 0.171956 May 17 17:12:09.286298 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 134/287] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:09 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:09.365571 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-93f58fe2-38f5-41e5-ae7b-1f5a986d32de tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:09.375178 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-93f58fe2-38f5-41e5-ae7b-1f5a986d32de tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.213785 May 17 17:12:09.375959 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 154/288] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:09 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:09.424095 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b45ba033-24d9-40ba-80a3-f656ba1f2025 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:09.424804 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-b45ba033-24d9-40ba-80a3-f656ba1f2025 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:09.431930 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b45ba033-24d9-40ba-80a3-f656ba1f2025 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:09.432380 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b45ba033-24d9-40ba-80a3-f656ba1f2025 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:09.433273 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b45ba033-24d9-40ba-80a3-f656ba1f2025 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:09.433632 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b45ba033-24d9-40ba-80a3-f656ba1f2025 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:09.511001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-b45ba033-24d9-40ba-80a3-f656ba1f2025 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:09.521078 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-b45ba033-24d9-40ba-80a3-f656ba1f2025 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1271 microversion: 2.1 time: 0.100331 May 17 17:12:09.521793 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 135/289] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:09 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:10.306885 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-091aaaca-c38f-4729-8757-53f2449469b8 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:10.308316 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-091aaaca-c38f-4729-8757-53f2449469b8 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] [instance: 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:10.315943 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-091aaaca-c38f-4729-8757-53f2449469b8 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:10.317019 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-091aaaca-c38f-4729-8757-53f2449469b8 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:10.318135 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-091aaaca-c38f-4729-8757-53f2449469b8 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:10.318867 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-091aaaca-c38f-4729-8757-53f2449469b8 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:10.342384 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-091aaaca-c38f-4729-8757-53f2449469b8 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] HTTP exception thrown: Instance 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb could not be found. May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-091aaaca-c38f-4729-8757-53f2449469b8 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Request method failure captured: May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb HTTP/1.1 May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9c4bYRWqR9m7EyiGA_qvsIuZMvt8fbGt5-AM1ddPGSsXkTESqpOwQ6ZZw3cNYBFq_0Z8olMB2bVCEcSiApSopY7C3vD2NGucrgr_2pJ_o1lVZNHCF-O_3ZlQg2M6On3h9qudCSyUeXq-4sUvJXu3hV9fV5yfvCPg1KBWIRYdQoNCBw May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: b5858756d2b74673a765c1d2e6adf280 May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-VolumesActionsTest-1378399647 May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:12:10.345066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:12:10.346820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b5858756d2b74673a765c1d2e6adf280"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b5858756d2b74673a765c1d2e6adf280"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b5858756d2b74673a765c1d2e6adf280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b5858756d2b74673a765c1d2e6adf280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:12:10.346820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-VolumesActionsTest-1378399647 May 17 17:12:10.346820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: b5858756d2b74673a765c1d2e6adf280 May 17 17:12:10.346820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-VolumesActionsTest-1378399647 May 17 17:12:10.346820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-VolumesActionsTest-1378399647-project May 17 17:12:10.346820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:12:10.346820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:12:10.346820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: c3feefbd066d49148171c392838b4e15 May 17 17:12:10.346820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-VolumesActionsTest-1378399647-project May 17 17:12:10.346820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:12:10.346820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb could not be found. May 17 17:12:10.346820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '8f3bf001-c3b2-461b-99a8-5121b6a4a1eb'} May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb could not be found. May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:12:10.349085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb could not be found. May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb could not be found. May 17 17:12:10.351148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:12:10.354500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-091aaaca-c38f-4729-8757-53f2449469b8 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] Returning 404 to user: Instance 8f3bf001-c3b2-461b-99a8-5121b6a4a1eb could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:12:10.355634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-091aaaca-c38f-4729-8757-53f2449469b8 tempest-VolumesActionsTest-1378399647 tempest-VolumesActionsTest-1378399647-project] 10.222.0.48 "GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb" status: 404 len: 111 microversion: 2.1 time: 0.056488 May 17 17:12:10.356654 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 155/290] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:10 2022] GET /compute/v2.1/servers/8f3bf001-c3b2-461b-99a8-5121b6a4a1eb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:12:10.393027 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-337fe970-b9ce-4301-a773-e77d60189fac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:10.393647 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-337fe970-b9ce-4301-a773-e77d60189fac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:10.402698 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-337fe970-b9ce-4301-a773-e77d60189fac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:10.403822 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-337fe970-b9ce-4301-a773-e77d60189fac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:10.404561 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-337fe970-b9ce-4301-a773-e77d60189fac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:10.405059 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-337fe970-b9ce-4301-a773-e77d60189fac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:10.539081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-170d22a5-19d6-4852-81a1-7de94327dbed tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:10.539901 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-170d22a5-19d6-4852-81a1-7de94327dbed tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:10.553438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-170d22a5-19d6-4852-81a1-7de94327dbed tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:10.554176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-170d22a5-19d6-4852-81a1-7de94327dbed tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:10.555108 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-170d22a5-19d6-4852-81a1-7de94327dbed tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:10.555735 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-170d22a5-19d6-4852-81a1-7de94327dbed tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:10.893444 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-337fe970-b9ce-4301-a773-e77d60189fac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:10.909980 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-337fe970-b9ce-4301-a773-e77d60189fac tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.521241 May 17 17:12:10.920889 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 136/291] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:10 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:11.184056 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-170d22a5-19d6-4852-81a1-7de94327dbed tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:11.195630 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-170d22a5-19d6-4852-81a1-7de94327dbed tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1313 microversion: 2.1 time: 0.660915 May 17 17:12:11.196511 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 156/292] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:10 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1313 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:11.291256 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-9345fb41-aec1-4318-b6f3-e2bd0134b279 req-7d7e7dd6-47ee-4aa6-8ebc-8e611ac28710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1127edfe-a0d6-403d-b83d-e7b55dba4cbf", "tag": "e148e602-2871-4651-9e6a-6b54bb29294a"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:11.311003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-9345fb41-aec1-4318-b6f3-e2bd0134b279 req-7d7e7dd6-47ee-4aa6-8ebc-8e611ac28710 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:11.313164 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-9345fb41-aec1-4318-b6f3-e2bd0134b279 req-7d7e7dd6-47ee-4aa6-8ebc-8e611ac28710 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:11.340292 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-9345fb41-aec1-4318-b6f3-e2bd0134b279 req-7d7e7dd6-47ee-4aa6-8ebc-8e611ac28710 service nova] Creating event network-changed:e148e602-2871-4651-9e6a-6b54bb29294a for instance 1127edfe-a0d6-403d-b83d-e7b55dba4cbf on hv-cinder-84214 May 17 17:12:11.346582 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-9345fb41-aec1-4318-b6f3-e2bd0134b279 req-7d7e7dd6-47ee-4aa6-8ebc-8e611ac28710 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060440 May 17 17:12:11.352116 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 137/293] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:11.748190 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-456eb0e9-ed1f-4651-b6aa-fb244d017469 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:11.748685 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-456eb0e9-ed1f-4651-b6aa-fb244d017469 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:11.757456 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-456eb0e9-ed1f-4651-b6aa-fb244d017469 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:11.757915 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-456eb0e9-ed1f-4651-b6aa-fb244d017469 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:11.758706 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-456eb0e9-ed1f-4651-b6aa-fb244d017469 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:11.759143 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-456eb0e9-ed1f-4651-b6aa-fb244d017469 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:11.797857 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-456eb0e9-ed1f-4651-b6aa-fb244d017469 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/ips" status: 200 len: 147 microversion: 2.1 time: 0.054136 May 17 17:12:11.798829 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 157/294] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 17 17:12:11 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/ips => generated 147 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:11.929344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7a9fbbd9-541d-4328-8c64-66156acdd04d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:11.930043 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7a9fbbd9-541d-4328-8c64-66156acdd04d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:11.936867 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7a9fbbd9-541d-4328-8c64-66156acdd04d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:11.937844 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7a9fbbd9-541d-4328-8c64-66156acdd04d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:11.939313 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7a9fbbd9-541d-4328-8c64-66156acdd04d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:11.940295 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7a9fbbd9-541d-4328-8c64-66156acdd04d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:12.195412 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7a9fbbd9-541d-4328-8c64-66156acdd04d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:12.203452 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7a9fbbd9-541d-4328-8c64-66156acdd04d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.279684 May 17 17:12:12.204716 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 138/295] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:11 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:12.213621 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f3609123-b9c8-4422-adc8-b9fab12ec1b3 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:12.214784 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f3609123-b9c8-4422-adc8-b9fab12ec1b3 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:12.235924 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3609123-b9c8-4422-adc8-b9fab12ec1b3 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:12.236085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3609123-b9c8-4422-adc8-b9fab12ec1b3 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:12.236809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3609123-b9c8-4422-adc8-b9fab12ec1b3 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:12.237690 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3609123-b9c8-4422-adc8-b9fab12ec1b3 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:12.499720 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f3609123-b9c8-4422-adc8-b9fab12ec1b3 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:12.508252 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f3609123-b9c8-4422-adc8-b9fab12ec1b3 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1313 microversion: 2.1 time: 0.298748 May 17 17:12:12.509019 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 158/296] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:12 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:13.221523 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9bd224cf-589b-492f-bedc-266c034819f3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:13.223551 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9bd224cf-589b-492f-bedc-266c034819f3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:13.230184 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9bd224cf-589b-492f-bedc-266c034819f3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:13.230910 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9bd224cf-589b-492f-bedc-266c034819f3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:13.231888 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9bd224cf-589b-492f-bedc-266c034819f3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:13.232481 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9bd224cf-589b-492f-bedc-266c034819f3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:13.525539 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-053bbc1b-6d72-428d-b68c-ffed588eb6d7 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:13.526176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-053bbc1b-6d72-428d-b68c-ffed588eb6d7 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:13.533109 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-053bbc1b-6d72-428d-b68c-ffed588eb6d7 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:13.533710 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-053bbc1b-6d72-428d-b68c-ffed588eb6d7 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:13.534836 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-053bbc1b-6d72-428d-b68c-ffed588eb6d7 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:13.535414 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-053bbc1b-6d72-428d-b68c-ffed588eb6d7 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:13.563005 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9bd224cf-589b-492f-bedc-266c034819f3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:13.574180 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9bd224cf-589b-492f-bedc-266c034819f3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.356904 May 17 17:12:13.574761 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 139/297] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:13 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:13.964519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-053bbc1b-6d72-428d-b68c-ffed588eb6d7 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:13.972702 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-053bbc1b-6d72-428d-b68c-ffed588eb6d7 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1313 microversion: 2.1 time: 0.450485 May 17 17:12:13.982126 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 159/298] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:13 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:14.596061 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e2cefd16-bcb5-4d23-931b-945d3f02e177 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:14.597420 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e2cefd16-bcb5-4d23-931b-945d3f02e177 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:14.606719 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e2cefd16-bcb5-4d23-931b-945d3f02e177 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:14.607371 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e2cefd16-bcb5-4d23-931b-945d3f02e177 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:14.608363 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e2cefd16-bcb5-4d23-931b-945d3f02e177 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:14.608957 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e2cefd16-bcb5-4d23-931b-945d3f02e177 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:14.835359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e2cefd16-bcb5-4d23-931b-945d3f02e177 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:14.845749 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e2cefd16-bcb5-4d23-931b-945d3f02e177 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.254775 May 17 17:12:14.848104 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 140/299] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:14 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:14.998595 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9a3e8749-f7e3-415c-9bd2-c94c5a3e61da tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:15.000417 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9a3e8749-f7e3-415c-9bd2-c94c5a3e61da tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:15.008412 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9a3e8749-f7e3-415c-9bd2-c94c5a3e61da tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:15.009067 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9a3e8749-f7e3-415c-9bd2-c94c5a3e61da tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:15.010067 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9a3e8749-f7e3-415c-9bd2-c94c5a3e61da tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:15.010495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9a3e8749-f7e3-415c-9bd2-c94c5a3e61da tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:15.242654 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9a3e8749-f7e3-415c-9bd2-c94c5a3e61da tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:15.250603 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9a3e8749-f7e3-415c-9bd2-c94c5a3e61da tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1313 microversion: 2.1 time: 0.260399 May 17 17:12:15.251180 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 160/300] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:14 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:15.522210 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-bf884cc5-e26f-4a6d-a97e-0b35d8004902 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04fcdc72-fdad-4ffc-adb5-93fcd017f601"}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:15.523340 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-bf884cc5-e26f-4a6d-a97e-0b35d8004902 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:15.529915 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bf884cc5-e26f-4a6d-a97e-0b35d8004902 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:15.530373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bf884cc5-e26f-4a6d-a97e-0b35d8004902 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:15.531151 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bf884cc5-e26f-4a6d-a97e-0b35d8004902 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:15.531590 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bf884cc5-e26f-4a6d-a97e-0b35d8004902 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:15.760748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-fa0ca78a-7446-4960-a4a1-0218a97d1aa6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:15.761243 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-fa0ca78a-7446-4960-a4a1-0218a97d1aa6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:15.766959 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fa0ca78a-7446-4960-a4a1-0218a97d1aa6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:15.767412 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fa0ca78a-7446-4960-a4a1-0218a97d1aa6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:15.768224 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fa0ca78a-7446-4960-a4a1-0218a97d1aa6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:15.768655 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fa0ca78a-7446-4960-a4a1-0218a97d1aa6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:15.795493 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-fa0ca78a-7446-4960-a4a1-0218a97d1aa6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/ips" status: 200 len: 151 microversion: 2.20 time: 0.038589 May 17 17:12:15.796328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 161/301] 10.222.0.48 () {60 vars in 1288 bytes} [Tue May 17 17:12:15 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:12:15.864190 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-dd39b413-1ce8-461b-9d48-0c0e44513d57 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:15.864805 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-dd39b413-1ce8-461b-9d48-0c0e44513d57 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:15.882318 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dd39b413-1ce8-461b-9d48-0c0e44513d57 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:15.884546 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dd39b413-1ce8-461b-9d48-0c0e44513d57 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:15.885476 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dd39b413-1ce8-461b-9d48-0c0e44513d57 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:15.885951 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dd39b413-1ce8-461b-9d48-0c0e44513d57 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:16.118636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-dd39b413-1ce8-461b-9d48-0c0e44513d57 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:16.134010 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-dd39b413-1ce8-461b-9d48-0c0e44513d57 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.273094 May 17 17:12:16.135716 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 162/302] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:15 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:16.268461 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d61ca366-88d3-4a64-add1-b3a97c65dbe6 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:16.269710 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d61ca366-88d3-4a64-add1-b3a97c65dbe6 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:16.283757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d61ca366-88d3-4a64-add1-b3a97c65dbe6 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:16.284226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d61ca366-88d3-4a64-add1-b3a97c65dbe6 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:16.295181 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d61ca366-88d3-4a64-add1-b3a97c65dbe6 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:16.295876 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d61ca366-88d3-4a64-add1-b3a97c65dbe6 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:16.339963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-bf884cc5-e26f-4a6d-a97e-0b35d8004902 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "POST /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821239 May 17 17:12:16.341011 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 141/303] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 17 17:12:15 2022] POST /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/os-volume_attachments => generated 194 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:16.683037 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d61ca366-88d3-4a64-add1-b3a97c65dbe6 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:16.693761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d61ca366-88d3-4a64-add1-b3a97c65dbe6 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1313 microversion: 2.1 time: 0.427596 May 17 17:12:16.698083 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 163/304] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:16 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:17.153368 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9dcb8983-a80a-46d5-a5d0-a06c8277c365 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:17.154055 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9dcb8983-a80a-46d5-a5d0-a06c8277c365 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:17.163764 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9dcb8983-a80a-46d5-a5d0-a06c8277c365 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:17.164651 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9dcb8983-a80a-46d5-a5d0-a06c8277c365 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:17.166043 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9dcb8983-a80a-46d5-a5d0-a06c8277c365 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:17.166953 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9dcb8983-a80a-46d5-a5d0-a06c8277c365 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:17.364141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9dcb8983-a80a-46d5-a5d0-a06c8277c365 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:17.374873 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9dcb8983-a80a-46d5-a5d0-a06c8277c365 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.225618 May 17 17:12:17.386437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 142/305] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:17 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:17.712932 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-45a3d580-57fa-4f10-b6ee-7e84f964806d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:17.713582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-45a3d580-57fa-4f10-b6ee-7e84f964806d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:17.723104 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-45a3d580-57fa-4f10-b6ee-7e84f964806d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:17.725952 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-45a3d580-57fa-4f10-b6ee-7e84f964806d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:17.728922 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-45a3d580-57fa-4f10-b6ee-7e84f964806d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:17.729546 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-45a3d580-57fa-4f10-b6ee-7e84f964806d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:17.936374 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-45a3d580-57fa-4f10-b6ee-7e84f964806d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:17.948311 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-45a3d580-57fa-4f10-b6ee-7e84f964806d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1313 microversion: 2.1 time: 0.239321 May 17 17:12:17.949652 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 164/306] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:17 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:18.394257 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7d43e0c7-f68e-45f4-b423-3ba5f7b238e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:18.395070 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7d43e0c7-f68e-45f4-b423-3ba5f7b238e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:18.405340 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7d43e0c7-f68e-45f4-b423-3ba5f7b238e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:18.408876 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7d43e0c7-f68e-45f4-b423-3ba5f7b238e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:18.411138 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7d43e0c7-f68e-45f4-b423-3ba5f7b238e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:18.416437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7d43e0c7-f68e-45f4-b423-3ba5f7b238e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:18.741879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7d43e0c7-f68e-45f4-b423-3ba5f7b238e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:18.778023 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7d43e0c7-f68e-45f4-b423-3ba5f7b238e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.388953 May 17 17:12:18.788826 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 143/307] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:18 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:18.845955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7c6ceaf6-6381-49e7-9298-00b3e7f0499e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:18.847454 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7c6ceaf6-6381-49e7-9298-00b3e7f0499e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:18.854433 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7c6ceaf6-6381-49e7-9298-00b3e7f0499e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:18.855019 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7c6ceaf6-6381-49e7-9298-00b3e7f0499e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:18.857501 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7c6ceaf6-6381-49e7-9298-00b3e7f0499e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:18.858485 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7c6ceaf6-6381-49e7-9298-00b3e7f0499e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:18.920251 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-7c6ceaf6-6381-49e7-9298-00b3e7f0499e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lazy-loading 'flavor' on Instance uuid b074c961-149b-4667-addc-790568769b88 {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:12:18.966831 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4fd116ef-e575-40f2-9152-b71c94972c06 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:18.971346 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4fd116ef-e575-40f2-9152-b71c94972c06 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:18.994831 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4fd116ef-e575-40f2-9152-b71c94972c06 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:18.997057 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4fd116ef-e575-40f2-9152-b71c94972c06 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:19.001444 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4fd116ef-e575-40f2-9152-b71c94972c06 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:19.002425 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4fd116ef-e575-40f2-9152-b71c94972c06 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:19.348305 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4fd116ef-e575-40f2-9152-b71c94972c06 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:19.364892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4fd116ef-e575-40f2-9152-b71c94972c06 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1313 microversion: 2.1 time: 0.402067 May 17 17:12:19.365804 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 144/308] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:18 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:19.803811 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e3e5cbdc-a273-4d62-8fea-df2b7bc8cb0b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:19.804488 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e3e5cbdc-a273-4d62-8fea-df2b7bc8cb0b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:19.842556 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7c6ceaf6-6381-49e7-9298-00b3e7f0499e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "POST /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/action" status: 202 len: 0 microversion: 2.20 time: 1.002511 May 17 17:12:19.845669 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e3e5cbdc-a273-4d62-8fea-df2b7bc8cb0b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:19.847533 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 165/309] 10.222.0.48 () {62 vars in 1318 bytes} [Tue May 17 17:12:18 2022] POST /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/action => generated 0 bytes in 1008 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 17:12:19.859207 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b34e3f85-9904-426b-8aa0-4c66d2256848 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:19.859996 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b34e3f85-9904-426b-8aa0-4c66d2256848 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:19.883896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b34e3f85-9904-426b-8aa0-4c66d2256848 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:19.884131 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e3e5cbdc-a273-4d62-8fea-df2b7bc8cb0b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:19.884348 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b34e3f85-9904-426b-8aa0-4c66d2256848 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:19.885140 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b34e3f85-9904-426b-8aa0-4c66d2256848 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:19.885424 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e3e5cbdc-a273-4d62-8fea-df2b7bc8cb0b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:19.885577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b34e3f85-9904-426b-8aa0-4c66d2256848 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:19.887323 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e3e5cbdc-a273-4d62-8fea-df2b7bc8cb0b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:21.163030 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e3e5cbdc-a273-4d62-8fea-df2b7bc8cb0b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:21.186253 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e3e5cbdc-a273-4d62-8fea-df2b7bc8cb0b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 1.392150 May 17 17:12:21.186865 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 145/310] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:19 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:21.200688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1ad7396d-6d0b-4c64-a0ee-b9ec13fc1891 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:21.202568 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1ad7396d-6d0b-4c64-a0ee-b9ec13fc1891 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:21.213074 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1ad7396d-6d0b-4c64-a0ee-b9ec13fc1891 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:21.213822 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1ad7396d-6d0b-4c64-a0ee-b9ec13fc1891 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:21.214791 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1ad7396d-6d0b-4c64-a0ee-b9ec13fc1891 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:21.215377 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1ad7396d-6d0b-4c64-a0ee-b9ec13fc1891 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:21.267328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b34e3f85-9904-426b-8aa0-4c66d2256848 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:21.297251 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b34e3f85-9904-426b-8aa0-4c66d2256848 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:21.301057 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b34e3f85-9904-426b-8aa0-4c66d2256848 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:21.304645 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b34e3f85-9904-426b-8aa0-4c66d2256848 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 1.451921 May 17 17:12:21.306138 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 166/311] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:19 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:21.477619 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1ad7396d-6d0b-4c64-a0ee-b9ec13fc1891 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:21.488902 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1ad7396d-6d0b-4c64-a0ee-b9ec13fc1891 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1313 microversion: 2.1 time: 0.300331 May 17 17:12:21.501397 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 146/312] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:21 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:22.055265 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-e31b7f19-e200-4b27-b4e3-57bc5244eacb req-3af4731d-ccf0-43a1-bd45-1a900215cd58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1127edfe-a0d6-403d-b83d-e7b55dba4cbf", "name": "network-vif-plugged", "status": "completed", "tag": "e148e602-2871-4651-9e6a-6b54bb29294a"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:22.073553 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-e31b7f19-e200-4b27-b4e3-57bc5244eacb req-3af4731d-ccf0-43a1-bd45-1a900215cd58 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:22.074028 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-e31b7f19-e200-4b27-b4e3-57bc5244eacb req-3af4731d-ccf0-43a1-bd45-1a900215cd58 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:22.093855 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-e31b7f19-e200-4b27-b4e3-57bc5244eacb req-3af4731d-ccf0-43a1-bd45-1a900215cd58 service nova] Creating event network-vif-plugged:e148e602-2871-4651-9e6a-6b54bb29294a for instance 1127edfe-a0d6-403d-b83d-e7b55dba4cbf on hv-cinder-84214 May 17 17:12:22.100157 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-e31b7f19-e200-4b27-b4e3-57bc5244eacb req-3af4731d-ccf0-43a1-bd45-1a900215cd58 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050878 May 17 17:12:22.101039 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 167/313] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:22.221098 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a4619fca-3746-4a0d-a028-5ca45cfebc1d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:22.223317 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a4619fca-3746-4a0d-a028-5ca45cfebc1d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:22.234967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a4619fca-3746-4a0d-a028-5ca45cfebc1d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:22.235892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a4619fca-3746-4a0d-a028-5ca45cfebc1d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:22.236921 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a4619fca-3746-4a0d-a028-5ca45cfebc1d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:22.238479 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a4619fca-3746-4a0d-a028-5ca45cfebc1d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:22.343342 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1314354f-b750-4e14-b80c-f48ebd98ae07 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:22.348628 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1314354f-b750-4e14-b80c-f48ebd98ae07 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:22.367097 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1314354f-b750-4e14-b80c-f48ebd98ae07 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:22.368204 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1314354f-b750-4e14-b80c-f48ebd98ae07 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:22.369754 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1314354f-b750-4e14-b80c-f48ebd98ae07 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:22.376953 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1314354f-b750-4e14-b80c-f48ebd98ae07 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:23.007474 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a4619fca-3746-4a0d-a028-5ca45cfebc1d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:23.015804 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a4619fca-3746-4a0d-a028-5ca45cfebc1d tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.816058 May 17 17:12:23.016385 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 147/314] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:22 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:23.039205 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ff386cd1-394a-411e-b6b2-679d2121acb9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:23.041029 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1314354f-b750-4e14-b80c-f48ebd98ae07 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:23.044584 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ff386cd1-394a-411e-b6b2-679d2121acb9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:23.057433 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1314354f-b750-4e14-b80c-f48ebd98ae07 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:23.058825 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff386cd1-394a-411e-b6b2-679d2121acb9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:23.061261 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1314354f-b750-4e14-b80c-f48ebd98ae07 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:23.067634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1314354f-b750-4e14-b80c-f48ebd98ae07 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.747052 May 17 17:12:23.070842 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 168/315] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:22 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:12:23.078997 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff386cd1-394a-411e-b6b2-679d2121acb9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:23.079977 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff386cd1-394a-411e-b6b2-679d2121acb9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:23.080448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff386cd1-394a-411e-b6b2-679d2121acb9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:23.492579 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ff386cd1-394a-411e-b6b2-679d2121acb9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:23.520305 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ff386cd1-394a-411e-b6b2-679d2121acb9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1313 microversion: 2.1 time: 0.496675 May 17 17:12:23.522753 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 148/316] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:23 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:24.035856 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-072ceeaf-d46e-4374-b400-a11b324f1547 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:24.036715 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-072ceeaf-d46e-4374-b400-a11b324f1547 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:24.063682 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-072ceeaf-d46e-4374-b400-a11b324f1547 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:24.067765 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-072ceeaf-d46e-4374-b400-a11b324f1547 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:24.068917 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-072ceeaf-d46e-4374-b400-a11b324f1547 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:24.069522 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-072ceeaf-d46e-4374-b400-a11b324f1547 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:24.089775 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1c85ecb5-b1da-45c0-b63b-b0c303b5f06e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:24.090631 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1c85ecb5-b1da-45c0-b63b-b0c303b5f06e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:24.124826 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1c85ecb5-b1da-45c0-b63b-b0c303b5f06e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:24.125482 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1c85ecb5-b1da-45c0-b63b-b0c303b5f06e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:24.128271 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1c85ecb5-b1da-45c0-b63b-b0c303b5f06e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:24.145895 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1c85ecb5-b1da-45c0-b63b-b0c303b5f06e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:24.576296 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-072ceeaf-d46e-4374-b400-a11b324f1547 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:24.594562 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-072ceeaf-d46e-4374-b400-a11b324f1547 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1502 microversion: 2.1 time: 0.565237 May 17 17:12:24.595752 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 169/317] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:24 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1502 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:24.608030 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e11b77af-f006-4c9c-8f85-4a8027ff0363 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35878e28-7d52-4114-8ac5-1f0b95a31305", "device": "/dev/sdb"}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:24.609902 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-e11b77af-f006-4c9c-8f85-4a8027ff0363 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:24.621714 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e11b77af-f006-4c9c-8f85-4a8027ff0363 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:24.622549 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e11b77af-f006-4c9c-8f85-4a8027ff0363 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:24.623698 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e11b77af-f006-4c9c-8f85-4a8027ff0363 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:24.624375 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e11b77af-f006-4c9c-8f85-4a8027ff0363 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:24.633411 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1c85ecb5-b1da-45c0-b63b-b0c303b5f06e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:24.645084 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1c85ecb5-b1da-45c0-b63b-b0c303b5f06e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:24.646783 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1c85ecb5-b1da-45c0-b63b-b0c303b5f06e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:24.653565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1c85ecb5-b1da-45c0-b63b-b0c303b5f06e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.567422 May 17 17:12:24.655580 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 149/318] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:24 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:24.667549 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d5cec402-db4a-4f56-8d1f-7a15960193f2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:24.682772 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d5cec402-db4a-4f56-8d1f-7a15960193f2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:24.683227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d5cec402-db4a-4f56-8d1f-7a15960193f2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:24.812551 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d5cec402-db4a-4f56-8d1f-7a15960193f2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Going to try to stop instance {{(pid=117089) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 17 17:12:24.871067 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d5cec402-db4a-4f56-8d1f-7a15960193f2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "POST /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/action" status: 202 len: 0 microversion: 2.1 time: 0.213980 May 17 17:12:24.871955 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 150/319] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 17 17:12:24 2022] POST /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:12:24.886688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ce410938-5d74-4212-950d-a1153113487a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:24.887661 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ce410938-5d74-4212-950d-a1153113487a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:24.894924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ce410938-5d74-4212-950d-a1153113487a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:24.895879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ce410938-5d74-4212-950d-a1153113487a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:24.896878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ce410938-5d74-4212-950d-a1153113487a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:24.897545 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ce410938-5d74-4212-950d-a1153113487a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:25.096630 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ce410938-5d74-4212-950d-a1153113487a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:25.104695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ce410938-5d74-4212-950d-a1153113487a tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1313 microversion: 2.1 time: 0.231401 May 17 17:12:25.105898 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 151/320] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:24 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:25.111982 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3fc57d51-42d4-4481-bead-e4e80c5a33f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e34cb818-c462-465d-a851-d1a60eb1787f"}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:25.114201 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3fc57d51-42d4-4481-bead-e4e80c5a33f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:25.122342 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3fc57d51-42d4-4481-bead-e4e80c5a33f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:25.122897 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3fc57d51-42d4-4481-bead-e4e80c5a33f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:25.123964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3fc57d51-42d4-4481-bead-e4e80c5a33f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:25.124507 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3fc57d51-42d4-4481-bead-e4e80c5a33f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:25.171290 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-3fc57d51-42d4-4481-bead-e4e80c5a33f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] HTTP exception thrown: Cannot 'attach_volume' instance 09d096e1-5210-41e8-ae6e-dee03652b474 while it is in vm_state rescued May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3fc57d51-42d4-4481-bead-e4e80c5a33f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Request method failure captured: May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: POST /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474/os-volume_attachments HTTP/1.1 May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 74 May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9cIPlWrQVek_vO5Ab0bf4nYehP1BOWbMBXN-eF9jKvTtM2GSDDAPWJwb8WErqNIdz21bajaEg0P-_qRMTFIo8qTg4RCl1kwggv7oxyH9A5chbw_cqFQQScvlEt6ZZFtWpTXePcbpGZ2EJTY3cBM3VYORCJtl3kWRUuCWHEpw7EGcl4 May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: ea3305a913c541e4a45267497213df1c May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:12:25.173493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:12:25.175140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea3305a913c541e4a45267497213df1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea3305a913c541e4a45267497213df1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea3305a913c541e4a45267497213df1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea3305a913c541e4a45267497213df1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:12:25.175140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:12:25.175140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: ea3305a913c541e4a45267497213df1c May 17 17:12:25.175140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:12:25.175140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-ServerRescueNegativeTestJSON-1349300293-project May 17 17:12:25.175140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:12:25.175140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:12:25.175140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 824915e26a724d938e5dd0a3c1f57932 May 17 17:12:25.175140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349300293-project May 17 17:12:25.175140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: May 17 17:12:25.175140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {"volumeAttachment": {"volumeId": "e34cb818-c462-465d-a851-d1a60eb1787f"}} May 17 17:12:25.175140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Cannot 'attach_volume' instance 09d096e1-5210-41e8-ae6e-dee03652b474 while it is in vm_state rescued May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'server_id': '09d096e1-5210-41e8-ae6e-dee03652b474', 'body': {'volumeAttachment': {'volumeId': 'e34cb818-c462-465d-a851-d1a60eb1787f'}}} May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 09d096e1-5210-41e8-ae6e-dee03652b474 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:12:25.175909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 09d096e1-5210-41e8-ae6e-dee03652b474 while it is in vm_state rescued May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:12:25.176995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:12:25.178099 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:12:25.178099 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:12:25.178099 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 09d096e1-5210-41e8-ae6e-dee03652b474 while it is in vm_state rescued May 17 17:12:25.178099 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:12:25.178099 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3fc57d51-42d4-4481-bead-e4e80c5a33f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Returning 409 to user: Cannot 'attach_volume' instance 09d096e1-5210-41e8-ae6e-dee03652b474 while it is in vm_state rescued {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:12:25.178099 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3fc57d51-42d4-4481-bead-e4e80c5a33f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "POST /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.068041 May 17 17:12:25.178099 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 152/321] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 17 17:12:25 2022] POST /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 17 17:12:25.181131 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0578aab0-ede1-46be-8104-1aec39f1e93e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:25.181625 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0578aab0-ede1-46be-8104-1aec39f1e93e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:25.188720 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0578aab0-ede1-46be-8104-1aec39f1e93e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:25.189283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0578aab0-ede1-46be-8104-1aec39f1e93e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:25.190921 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0578aab0-ede1-46be-8104-1aec39f1e93e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:25.191459 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0578aab0-ede1-46be-8104-1aec39f1e93e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:25.371875 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0578aab0-ede1-46be-8104-1aec39f1e93e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:25.383789 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0578aab0-ede1-46be-8104-1aec39f1e93e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.206501 May 17 17:12:25.384863 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 153/322] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:25 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:25.557121 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e11b77af-f006-4c9c-8f85-4a8027ff0363 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "POST /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.951516 May 17 17:12:25.557756 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 170/323] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 17 17:12:24 2022] POST /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15/os-volume_attachments => generated 194 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:25.567320 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a8b0444f-2e68-4c40-9169-1b7107b167cf tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:25.568682 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a8b0444f-2e68-4c40-9169-1b7107b167cf tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:25.576632 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8b0444f-2e68-4c40-9169-1b7107b167cf tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:25.577435 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8b0444f-2e68-4c40-9169-1b7107b167cf tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:25.578755 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8b0444f-2e68-4c40-9169-1b7107b167cf tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:25.579401 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8b0444f-2e68-4c40-9169-1b7107b167cf tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:25.674772 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a8b0444f-2e68-4c40-9169-1b7107b167cf tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "POST /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474/action" status: 202 len: 0 microversion: 2.1 time: 0.113596 May 17 17:12:25.678476 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 171/324] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 17 17:12:25 2022] POST /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:12:25.680294 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0de39cb5-c6d1-4e9f-aa29-7e67b6ba4f23 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Action: 'create', calling method: .version_select at 0x7feb181b14c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1446987121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7nNZSRV/W4ERsMbDPi5ohEuPwPz9aOhoNrUsBRUlxAAYY5pnKhLNHMNTTymvTHKdC+2K2v/KxzrBNQYr2u4EycK7Qz8fW+wFH8y+J6AFY8mkuGEJUhw93iy1yOF36epQ=="}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:25.681705 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d0c25004-5c76-4f2e-bd12-8301f687c575 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:25.682488 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d0c25004-5c76-4f2e-bd12-8301f687c575 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:25.689658 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d0c25004-5c76-4f2e-bd12-8301f687c575 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:25.690964 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d0c25004-5c76-4f2e-bd12-8301f687c575 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:25.692140 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d0c25004-5c76-4f2e-bd12-8301f687c575 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:25.694713 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d0c25004-5c76-4f2e-bd12-8301f687c575 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:25.700737 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-0de39cb5-c6d1-4e9f-aa29-7e67b6ba4f23 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Getting quotas for project 2630e0044e5f4f28b8d2adcfeaf0c604. Resources: {'key_pairs'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:12:25.704661 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-0de39cb5-c6d1-4e9f-aa29-7e67b6ba4f23 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Getting quotas for user 4302f72c503341d4a5367613edf38055 and project 2630e0044e5f4f28b8d2adcfeaf0c604. Resources: {'key_pairs'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:12:25.808704 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0de39cb5-c6d1-4e9f-aa29-7e67b6ba4f23 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.422361 May 17 17:12:25.809615 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 154/325] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 17 17:12:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:25.834764 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2412b8ee-7f93-4da6-a73d-754ac8e477a7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:25.835696 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2412b8ee-7f93-4da6-a73d-754ac8e477a7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:25.851326 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2412b8ee-7f93-4da6-a73d-754ac8e477a7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:25.853218 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2412b8ee-7f93-4da6-a73d-754ac8e477a7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:25.854583 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2412b8ee-7f93-4da6-a73d-754ac8e477a7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:25.857959 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2412b8ee-7f93-4da6-a73d-754ac8e477a7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:25.880141 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d0c25004-5c76-4f2e-bd12-8301f687c575 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:25.896228 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d0c25004-5c76-4f2e-bd12-8301f687c575 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:25.898037 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d0c25004-5c76-4f2e-bd12-8301f687c575 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:25.900432 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d0c25004-5c76-4f2e-bd12-8301f687c575 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.223624 May 17 17:12:25.904438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 172/326] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:25 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:26.072002 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2412b8ee-7f93-4da6-a73d-754ac8e477a7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:26.086679 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2412b8ee-7f93-4da6-a73d-754ac8e477a7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1510 microversion: 2.1 time: 0.270902 May 17 17:12:26.087379 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 155/327] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:25 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1510 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:26.128355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c3987ff5-b4e2-4c1f-bb4b-7298a5d220d9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:26.132551 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c3987ff5-b4e2-4c1f-bb4b-7298a5d220d9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:26.147128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c3987ff5-b4e2-4c1f-bb4b-7298a5d220d9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:26.148426 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c3987ff5-b4e2-4c1f-bb4b-7298a5d220d9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:26.151162 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c3987ff5-b4e2-4c1f-bb4b-7298a5d220d9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:26.152900 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c3987ff5-b4e2-4c1f-bb4b-7298a5d220d9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:26.402363 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7289ddf7-f8ae-4e52-809d-ec90fbaf1cd9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:26.403224 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7289ddf7-f8ae-4e52-809d-ec90fbaf1cd9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:26.413840 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7289ddf7-f8ae-4e52-809d-ec90fbaf1cd9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:26.417292 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7289ddf7-f8ae-4e52-809d-ec90fbaf1cd9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:26.418979 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7289ddf7-f8ae-4e52-809d-ec90fbaf1cd9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:26.419684 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7289ddf7-f8ae-4e52-809d-ec90fbaf1cd9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:26.457198 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c3987ff5-b4e2-4c1f-bb4b-7298a5d220d9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:26.470269 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c3987ff5-b4e2-4c1f-bb4b-7298a5d220d9 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1313 microversion: 2.1 time: 0.351448 May 17 17:12:26.471946 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 173/328] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:26 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:26.737747 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7289ddf7-f8ae-4e52-809d-ec90fbaf1cd9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:26.749968 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7289ddf7-f8ae-4e52-809d-ec90fbaf1cd9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.351621 May 17 17:12:26.751427 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 156/329] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:26 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:26.925391 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-6ebc241c-3ab3-4a16-ba6a-1492d590c023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:26.926106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-6ebc241c-3ab3-4a16-ba6a-1492d590c023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:26.935766 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6ebc241c-3ab3-4a16-ba6a-1492d590c023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:26.938428 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6ebc241c-3ab3-4a16-ba6a-1492d590c023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:26.942343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6ebc241c-3ab3-4a16-ba6a-1492d590c023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:26.944483 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6ebc241c-3ab3-4a16-ba6a-1492d590c023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:27.104224 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a0719d63-6df4-4082-94f9-fa9ca7a4e85b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:27.104849 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a0719d63-6df4-4082-94f9-fa9ca7a4e85b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:27.112429 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a0719d63-6df4-4082-94f9-fa9ca7a4e85b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:27.113814 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a0719d63-6df4-4082-94f9-fa9ca7a4e85b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:27.114881 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a0719d63-6df4-4082-94f9-fa9ca7a4e85b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:27.115504 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a0719d63-6df4-4082-94f9-fa9ca7a4e85b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:27.259475 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-6ebc241c-3ab3-4a16-ba6a-1492d590c023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:27.268164 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-6ebc241c-3ab3-4a16-ba6a-1492d590c023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:27.275853 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-6ebc241c-3ab3-4a16-ba6a-1492d590c023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:27.277220 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-6ebc241c-3ab3-4a16-ba6a-1492d590c023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.356711 May 17 17:12:27.281265 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 174/330] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:26 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:27.490711 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b9307421-3d8e-4869-b4f3-ee65cdcd451f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:27.491735 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b9307421-3d8e-4869-b4f3-ee65cdcd451f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:27.511119 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a0719d63-6df4-4082-94f9-fa9ca7a4e85b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:27.520858 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b9307421-3d8e-4869-b4f3-ee65cdcd451f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:27.523464 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b9307421-3d8e-4869-b4f3-ee65cdcd451f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:27.526030 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b9307421-3d8e-4869-b4f3-ee65cdcd451f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:27.527431 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a0719d63-6df4-4082-94f9-fa9ca7a4e85b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1510 microversion: 2.1 time: 0.422796 May 17 17:12:27.528253 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b9307421-3d8e-4869-b4f3-ee65cdcd451f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:27.531461 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 157/331] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:27 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1510 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:27.771224 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3e4851e3-2a29-40b0-be76-874471c18281 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:27.772086 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3e4851e3-2a29-40b0-be76-874471c18281 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:27.786642 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3e4851e3-2a29-40b0-be76-874471c18281 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:27.788964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3e4851e3-2a29-40b0-be76-874471c18281 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:27.790127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3e4851e3-2a29-40b0-be76-874471c18281 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:27.790880 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3e4851e3-2a29-40b0-be76-874471c18281 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:27.869430 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b9307421-3d8e-4869-b4f3-ee65cdcd451f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:27.881881 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b9307421-3d8e-4869-b4f3-ee65cdcd451f tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1463 microversion: 2.1 time: 0.397026 May 17 17:12:27.882887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 175/332] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:27 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1463 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:27.939141 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-4fbfe0ac-7e91-4864-9dc8-35c7435e2365 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:27.941003 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-4fbfe0ac-7e91-4864-9dc8-35c7435e2365 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:27.947592 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4fbfe0ac-7e91-4864-9dc8-35c7435e2365 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:27.949401 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4fbfe0ac-7e91-4864-9dc8-35c7435e2365 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:27.950437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4fbfe0ac-7e91-4864-9dc8-35c7435e2365 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:27.951111 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4fbfe0ac-7e91-4864-9dc8-35c7435e2365 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:28.007128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-4fbfe0ac-7e91-4864-9dc8-35c7435e2365 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Going to try to terminate instance {{(pid=117090) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:12:28.113464 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3e4851e3-2a29-40b0-be76-874471c18281 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:28.123809 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3e4851e3-2a29-40b0-be76-874471c18281 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.359267 May 17 17:12:28.124896 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 158/333] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:27 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:28.193510 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-4fbfe0ac-7e91-4864-9dc8-35c7435e2365 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 204 len: 0 microversion: 2.1 time: 0.257591 May 17 17:12:28.194724 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 176/334] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:12:27 2022] DELETE /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:12:28.202515 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f8430734-fe22-46e4-8357-3dcc9b63857c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:28.203740 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f8430734-fe22-46e4-8357-3dcc9b63857c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:28.211766 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f8430734-fe22-46e4-8357-3dcc9b63857c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:28.212567 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f8430734-fe22-46e4-8357-3dcc9b63857c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:28.213756 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f8430734-fe22-46e4-8357-3dcc9b63857c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:28.214428 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f8430734-fe22-46e4-8357-3dcc9b63857c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:28.302688 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2dee80d0-f541-42a8-bb0f-d28a51566430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:28.304963 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2dee80d0-f541-42a8-bb0f-d28a51566430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:28.319248 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2dee80d0-f541-42a8-bb0f-d28a51566430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:28.319924 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2dee80d0-f541-42a8-bb0f-d28a51566430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:28.321329 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2dee80d0-f541-42a8-bb0f-d28a51566430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:28.326108 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2dee80d0-f541-42a8-bb0f-d28a51566430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:28.446353 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f8430734-fe22-46e4-8357-3dcc9b63857c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:28.458010 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f8430734-fe22-46e4-8357-3dcc9b63857c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1469 microversion: 2.1 time: 0.259268 May 17 17:12:28.458591 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 159/335] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:28 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1469 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:28.540051 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2dee80d0-f541-42a8-bb0f-d28a51566430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:28.550702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7ca06f90-e3a7-4697-a08b-23966eee3427 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:28.551306 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2dee80d0-f541-42a8-bb0f-d28a51566430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:28.551477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7ca06f90-e3a7-4697-a08b-23966eee3427 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:28.553922 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2dee80d0-f541-42a8-bb0f-d28a51566430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:28.555432 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2dee80d0-f541-42a8-bb0f-d28a51566430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.259655 May 17 17:12:28.556614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 177/336] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:28 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:12:28.569712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7ca06f90-e3a7-4697-a08b-23966eee3427 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:28.571352 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7ca06f90-e3a7-4697-a08b-23966eee3427 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:28.572287 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7ca06f90-e3a7-4697-a08b-23966eee3427 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:28.572800 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7ca06f90-e3a7-4697-a08b-23966eee3427 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:28.823692 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7ca06f90-e3a7-4697-a08b-23966eee3427 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:28.834748 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7ca06f90-e3a7-4697-a08b-23966eee3427 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1510 microversion: 2.1 time: 0.289311 May 17 17:12:28.848718 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 160/337] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:28 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1510 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:29.161364 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b2116fe9-31e4-4afa-bd24-dd663d915563 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:29.164987 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b2116fe9-31e4-4afa-bd24-dd663d915563 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:29.196637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b2116fe9-31e4-4afa-bd24-dd663d915563 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:29.198643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b2116fe9-31e4-4afa-bd24-dd663d915563 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:29.199989 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b2116fe9-31e4-4afa-bd24-dd663d915563 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:29.200804 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b2116fe9-31e4-4afa-bd24-dd663d915563 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:29.430405 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b2116fe9-31e4-4afa-bd24-dd663d915563 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:29.441319 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b2116fe9-31e4-4afa-bd24-dd663d915563 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.297545 May 17 17:12:29.467938 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 178/338] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:29 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:29.478698 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-dd2ee800-d366-415b-abe5-f579c1b8130c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:29.479513 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-dd2ee800-d366-415b-abe5-f579c1b8130c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:29.489624 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dd2ee800-d366-415b-abe5-f579c1b8130c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:29.490137 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dd2ee800-d366-415b-abe5-f579c1b8130c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:29.491017 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dd2ee800-d366-415b-abe5-f579c1b8130c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:29.491497 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dd2ee800-d366-415b-abe5-f579c1b8130c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:29.574476 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-804f7172-6f7c-4d71-a072-50f88722f657 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:29.575362 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-804f7172-6f7c-4d71-a072-50f88722f657 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:29.589165 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-804f7172-6f7c-4d71-a072-50f88722f657 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:29.590120 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-804f7172-6f7c-4d71-a072-50f88722f657 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:29.591375 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-804f7172-6f7c-4d71-a072-50f88722f657 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:29.592073 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-804f7172-6f7c-4d71-a072-50f88722f657 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:29.707919 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-dd2ee800-d366-415b-abe5-f579c1b8130c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:29.720752 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-dd2ee800-d366-415b-abe5-f579c1b8130c tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1469 microversion: 2.1 time: 0.246319 May 17 17:12:29.732561 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 161/339] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:29 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1469 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:29.794524 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-804f7172-6f7c-4d71-a072-50f88722f657 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:29.805641 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-804f7172-6f7c-4d71-a072-50f88722f657 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:29.807148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-804f7172-6f7c-4d71-a072-50f88722f657 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:29.816819 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-804f7172-6f7c-4d71-a072-50f88722f657 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.237998 May 17 17:12:29.817467 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 179/340] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:29 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:29.851511 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-92561009-161d-4fb6-9ddc-a842eb08679e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:29.853215 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-92561009-161d-4fb6-9ddc-a842eb08679e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:29.865177 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-92561009-161d-4fb6-9ddc-a842eb08679e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:29.865985 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-92561009-161d-4fb6-9ddc-a842eb08679e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:29.866951 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-92561009-161d-4fb6-9ddc-a842eb08679e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:29.867582 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-92561009-161d-4fb6-9ddc-a842eb08679e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:30.052652 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-92561009-161d-4fb6-9ddc-a842eb08679e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:30.061217 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-92561009-161d-4fb6-9ddc-a842eb08679e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1510 microversion: 2.1 time: 0.213718 May 17 17:12:30.061812 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 162/341] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:29 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:30.474706 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-bc1562fa-f009-41c4-95ac-05d0578c7d90 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:30.476297 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-bc1562fa-f009-41c4-95ac-05d0578c7d90 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:30.483950 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bc1562fa-f009-41c4-95ac-05d0578c7d90 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:30.484639 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bc1562fa-f009-41c4-95ac-05d0578c7d90 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:30.485504 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bc1562fa-f009-41c4-95ac-05d0578c7d90 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:30.486032 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bc1562fa-f009-41c4-95ac-05d0578c7d90 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:30.634616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-bc1562fa-f009-41c4-95ac-05d0578c7d90 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:30.651332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-bc1562fa-f009-41c4-95ac-05d0578c7d90 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.180205 May 17 17:12:30.652873 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 180/342] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:30 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:30.738946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4e12c601-abe0-4785-b2a5-839e7655b5f4 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:30.739691 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4e12c601-abe0-4785-b2a5-839e7655b5f4 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:30.746533 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4e12c601-abe0-4785-b2a5-839e7655b5f4 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:30.747070 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4e12c601-abe0-4785-b2a5-839e7655b5f4 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:30.747963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4e12c601-abe0-4785-b2a5-839e7655b5f4 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:30.748438 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4e12c601-abe0-4785-b2a5-839e7655b5f4 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:30.835333 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a8c0ffaf-d8fd-410c-97ee-1d6f83d41615 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:30.835985 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a8c0ffaf-d8fd-410c-97ee-1d6f83d41615 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:30.848697 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8c0ffaf-d8fd-410c-97ee-1d6f83d41615 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:30.849144 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8c0ffaf-d8fd-410c-97ee-1d6f83d41615 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:30.849938 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8c0ffaf-d8fd-410c-97ee-1d6f83d41615 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:30.850678 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8c0ffaf-d8fd-410c-97ee-1d6f83d41615 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:30.959854 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4e12c601-abe0-4785-b2a5-839e7655b5f4 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:30.968453 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4e12c601-abe0-4785-b2a5-839e7655b5f4 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1469 microversion: 2.1 time: 0.233283 May 17 17:12:30.969556 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 163/343] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:30 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1469 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:31.048766 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a8c0ffaf-d8fd-410c-97ee-1d6f83d41615 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:31.057789 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a8c0ffaf-d8fd-410c-97ee-1d6f83d41615 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:31.059341 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a8c0ffaf-d8fd-410c-97ee-1d6f83d41615 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:31.060534 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a8c0ffaf-d8fd-410c-97ee-1d6f83d41615 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.229896 May 17 17:12:31.061310 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 181/344] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:30 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:12:31.078322 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-339c4c60-644c-45e0-b751-4c33ebb3d2a0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:31.078909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-339c4c60-644c-45e0-b751-4c33ebb3d2a0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:31.086673 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-339c4c60-644c-45e0-b751-4c33ebb3d2a0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:31.087125 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-339c4c60-644c-45e0-b751-4c33ebb3d2a0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:31.088054 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-339c4c60-644c-45e0-b751-4c33ebb3d2a0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:31.088498 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-339c4c60-644c-45e0-b751-4c33ebb3d2a0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:31.227074 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-339c4c60-644c-45e0-b751-4c33ebb3d2a0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:31.237614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-339c4c60-644c-45e0-b751-4c33ebb3d2a0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1510 microversion: 2.1 time: 0.162579 May 17 17:12:31.238188 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 164/345] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:31 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:31.669509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8a3260db-49cc-427a-8f3f-e82d2286fa57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:31.670213 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8a3260db-49cc-427a-8f3f-e82d2286fa57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:31.678542 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8a3260db-49cc-427a-8f3f-e82d2286fa57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:31.679133 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8a3260db-49cc-427a-8f3f-e82d2286fa57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:31.680136 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8a3260db-49cc-427a-8f3f-e82d2286fa57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:31.680863 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8a3260db-49cc-427a-8f3f-e82d2286fa57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:31.825959 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8a3260db-49cc-427a-8f3f-e82d2286fa57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:31.834610 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8a3260db-49cc-427a-8f3f-e82d2286fa57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.168942 May 17 17:12:31.835184 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 182/346] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:31 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:31.985745 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ac2d965f-30eb-4613-a2ee-d5f6a234fbac tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:31.987470 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ac2d965f-30eb-4613-a2ee-d5f6a234fbac tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:31.993758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ac2d965f-30eb-4613-a2ee-d5f6a234fbac tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:31.994418 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ac2d965f-30eb-4613-a2ee-d5f6a234fbac tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:31.995199 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ac2d965f-30eb-4613-a2ee-d5f6a234fbac tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:31.995729 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ac2d965f-30eb-4613-a2ee-d5f6a234fbac tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:32.084703 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-266fdeb9-272d-4726-b8d8-67bbc88c02e2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:32.085325 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-266fdeb9-272d-4726-b8d8-67bbc88c02e2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:32.137041 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-266fdeb9-272d-4726-b8d8-67bbc88c02e2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:32.138198 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-266fdeb9-272d-4726-b8d8-67bbc88c02e2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:32.139279 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-266fdeb9-272d-4726-b8d8-67bbc88c02e2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:32.140616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-266fdeb9-272d-4726-b8d8-67bbc88c02e2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:32.182120 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ac2d965f-30eb-4613-a2ee-d5f6a234fbac tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:32.192671 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ac2d965f-30eb-4613-a2ee-d5f6a234fbac tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1469 microversion: 2.1 time: 0.210929 May 17 17:12:32.205806 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 165/347] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:31 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1469 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:32.257897 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-299583a4-4be2-4bac-b1aa-50dea5aa2113 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:32.258879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-299583a4-4be2-4bac-b1aa-50dea5aa2113 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:32.267115 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-299583a4-4be2-4bac-b1aa-50dea5aa2113 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:32.268589 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-299583a4-4be2-4bac-b1aa-50dea5aa2113 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:32.270278 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-299583a4-4be2-4bac-b1aa-50dea5aa2113 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:32.271175 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-299583a4-4be2-4bac-b1aa-50dea5aa2113 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:32.316362 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-266fdeb9-272d-4726-b8d8-67bbc88c02e2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:32.327590 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-266fdeb9-272d-4726-b8d8-67bbc88c02e2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:32.329437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-266fdeb9-272d-4726-b8d8-67bbc88c02e2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:32.330706 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-266fdeb9-272d-4726-b8d8-67bbc88c02e2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.253595 May 17 17:12:32.331310 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 183/348] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:32 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:32.428834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-299583a4-4be2-4bac-b1aa-50dea5aa2113 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:32.436814 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-299583a4-4be2-4bac-b1aa-50dea5aa2113 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1516 microversion: 2.1 time: 0.184771 May 17 17:12:32.437605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 166/349] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:32 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:32.853046 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-4fb89add-dc9d-4dbf-abee-14894669e3e0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:32.853663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-4fb89add-dc9d-4dbf-abee-14894669e3e0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:32.860102 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4fb89add-dc9d-4dbf-abee-14894669e3e0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:32.860547 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4fb89add-dc9d-4dbf-abee-14894669e3e0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:32.861312 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4fb89add-dc9d-4dbf-abee-14894669e3e0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:32.861788 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4fb89add-dc9d-4dbf-abee-14894669e3e0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:32.993644 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-4fb89add-dc9d-4dbf-abee-14894669e3e0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:33.001741 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-4fb89add-dc9d-4dbf-abee-14894669e3e0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.152479 May 17 17:12:33.010566 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 184/350] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:32 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:33.211896 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-27f2235c-d297-4e2e-9063-583d7b1ab81d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:33.212511 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-27f2235c-d297-4e2e-9063-583d7b1ab81d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:33.218983 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-27f2235c-d297-4e2e-9063-583d7b1ab81d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:33.219616 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-27f2235c-d297-4e2e-9063-583d7b1ab81d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:33.220394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-27f2235c-d297-4e2e-9063-583d7b1ab81d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:33.221209 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-27f2235c-d297-4e2e-9063-583d7b1ab81d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:33.358425 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-eb08529e-a606-4693-bcbf-0656e31b1986 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:33.362021 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-eb08529e-a606-4693-bcbf-0656e31b1986 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:33.370646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-eb08529e-a606-4693-bcbf-0656e31b1986 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:33.371478 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-eb08529e-a606-4693-bcbf-0656e31b1986 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:33.372477 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-eb08529e-a606-4693-bcbf-0656e31b1986 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:33.373514 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-eb08529e-a606-4693-bcbf-0656e31b1986 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:33.420777 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-27f2235c-d297-4e2e-9063-583d7b1ab81d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:33.430697 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-27f2235c-d297-4e2e-9063-583d7b1ab81d tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1469 microversion: 2.1 time: 0.223336 May 17 17:12:33.433913 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 167/351] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:33 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1469 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:33.552985 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-eb08529e-a606-4693-bcbf-0656e31b1986 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:33.562476 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-eb08529e-a606-4693-bcbf-0656e31b1986 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:33.564046 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-eb08529e-a606-4693-bcbf-0656e31b1986 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:33.566251 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-eb08529e-a606-4693-bcbf-0656e31b1986 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.219985 May 17 17:12:33.578181 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 185/352] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:33 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:33.786472 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-080eec25-5f27-4438-b0e9-f3aef4e05d0f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Action: 'create', calling method: .version_select at 0x7feb181bca60>, body: {"keypair": {"name": "tempest-keypair-305926274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0O/BkI3GBQVja9ETwWSp34XrzSVz0SZHuOraNxE2Xz6eMSfGMkKZhK4FMrxrbFg3/tcnXQ6mj7AY72eh6+eKBvoaz9FCVU6eK7gXfcROiqrWPxFq3Gr8XpB5so6wHICw=="}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:33.806599 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-080eec25-5f27-4438-b0e9-f3aef4e05d0f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Getting quotas for project ea3305a913c541e4a45267497213df1c. Resources: {'key_pairs'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:12:33.812768 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-080eec25-5f27-4438-b0e9-f3aef4e05d0f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Getting quotas for user 824915e26a724d938e5dd0a3c1f57932 and project ea3305a913c541e4a45267497213df1c. Resources: {'key_pairs'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:12:33.844742 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-080eec25-5f27-4438-b0e9-f3aef4e05d0f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063526 May 17 17:12:33.847102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 168/353] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 17 17:12:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:12:34.019532 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-62e27a7e-eee7-4919-a038-2c25ddfb6fb5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:34.020184 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-62e27a7e-eee7-4919-a038-2c25ddfb6fb5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:34.030609 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-62e27a7e-eee7-4919-a038-2c25ddfb6fb5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:34.031095 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-62e27a7e-eee7-4919-a038-2c25ddfb6fb5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:34.031952 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-62e27a7e-eee7-4919-a038-2c25ddfb6fb5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:34.032393 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-62e27a7e-eee7-4919-a038-2c25ddfb6fb5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:34.308262 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-62e27a7e-eee7-4919-a038-2c25ddfb6fb5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:34.320590 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-62e27a7e-eee7-4919-a038-2c25ddfb6fb5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.305945 May 17 17:12:34.334079 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 186/354] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:34 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:34.435558 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-f1a1acdf-e5ad-452d-a385-63f5d0f0365c req-f369193a-7bec-49fe-b8f5-99075f54905e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1127edfe-a0d6-403d-b83d-e7b55dba4cbf", "name": "network-vif-deleted", "tag": "e148e602-2871-4651-9e6a-6b54bb29294a"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:34.449894 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-428c3068-7198-410f-b777-3aa498c3f4bd tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:34.450778 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-428c3068-7198-410f-b777-3aa498c3f4bd tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:34.458958 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-f1a1acdf-e5ad-452d-a385-63f5d0f0365c req-f369193a-7bec-49fe-b8f5-99075f54905e service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:34.459974 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-f1a1acdf-e5ad-452d-a385-63f5d0f0365c req-f369193a-7bec-49fe-b8f5-99075f54905e service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:34.463892 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-428c3068-7198-410f-b777-3aa498c3f4bd tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:34.465595 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-428c3068-7198-410f-b777-3aa498c3f4bd tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:34.467147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-428c3068-7198-410f-b777-3aa498c3f4bd tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:34.470180 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-428c3068-7198-410f-b777-3aa498c3f4bd tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:34.509785 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-f1a1acdf-e5ad-452d-a385-63f5d0f0365c req-f369193a-7bec-49fe-b8f5-99075f54905e service nova] Creating event network-vif-deleted:e148e602-2871-4651-9e6a-6b54bb29294a for instance 1127edfe-a0d6-403d-b83d-e7b55dba4cbf on hv-cinder-84214 May 17 17:12:34.547507 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-f1a1acdf-e5ad-452d-a385-63f5d0f0365c req-f369193a-7bec-49fe-b8f5-99075f54905e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119007 May 17 17:12:34.566164 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 169/355] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:34.586798 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-29a3be97-ad57-497a-bdbf-19d5f3747b27 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:34.587862 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-29a3be97-ad57-497a-bdbf-19d5f3747b27 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:34.597702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29a3be97-ad57-497a-bdbf-19d5f3747b27 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:34.604624 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29a3be97-ad57-497a-bdbf-19d5f3747b27 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:34.607378 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29a3be97-ad57-497a-bdbf-19d5f3747b27 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:34.609472 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29a3be97-ad57-497a-bdbf-19d5f3747b27 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:34.621602 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-428c3068-7198-410f-b777-3aa498c3f4bd tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e15f0e588042df9a7502c9f8d50479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd440db1af37449b1a5d268506dc5bf11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:34.633477 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-428c3068-7198-410f-b777-3aa498c3f4bd tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 200 len: 1427 microversion: 2.1 time: 0.188385 May 17 17:12:34.647592 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 187/356] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:34 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 1427 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:34.862551 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-29a3be97-ad57-497a-bdbf-19d5f3747b27 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:34.876552 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-29a3be97-ad57-497a-bdbf-19d5f3747b27 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:34.880908 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-29a3be97-ad57-497a-bdbf-19d5f3747b27 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:34.882394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-29a3be97-ad57-497a-bdbf-19d5f3747b27 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.299954 May 17 17:12:34.884449 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 170/357] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:34 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:35.347568 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c23c6298-508f-4e1a-b49b-1b5feb9b65d6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:35.348276 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c23c6298-508f-4e1a-b49b-1b5feb9b65d6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:35.376568 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c23c6298-508f-4e1a-b49b-1b5feb9b65d6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:35.378507 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c23c6298-508f-4e1a-b49b-1b5feb9b65d6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:35.382496 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c23c6298-508f-4e1a-b49b-1b5feb9b65d6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:35.388324 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c23c6298-508f-4e1a-b49b-1b5feb9b65d6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:35.590233 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c23c6298-508f-4e1a-b49b-1b5feb9b65d6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:35.605297 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c23c6298-508f-4e1a-b49b-1b5feb9b65d6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.267383 May 17 17:12:35.620834 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 188/358] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:35 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:35.654639 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-80a7cd4a-e8a6-4001-9dff-7ae374426d08 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:35.656022 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-80a7cd4a-e8a6-4001-9dff-7ae374426d08 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] [instance: 1127edfe-a0d6-403d-b83d-e7b55dba4cbf] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:35.663985 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80a7cd4a-e8a6-4001-9dff-7ae374426d08 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:35.664738 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80a7cd4a-e8a6-4001-9dff-7ae374426d08 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:35.665751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80a7cd4a-e8a6-4001-9dff-7ae374426d08 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:35.666393 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80a7cd4a-e8a6-4001-9dff-7ae374426d08 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:35.683361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-80a7cd4a-e8a6-4001-9dff-7ae374426d08 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] HTTP exception thrown: Instance 1127edfe-a0d6-403d-b83d-e7b55dba4cbf could not be found. May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-80a7cd4a-e8a6-4001-9dff-7ae374426d08 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Request method failure captured: May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf HTTP/1.1 May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9dj7IYkX_62EuetcBQeuhn6_Bnb_WUzCDVjn7kKAe9WrHcpPF8CAT2d-VegbTnBi1S1bhPkkbiNwiLWdkhnxcFGJ7qjCHVuG_P0P3_IYKw3RJ1Z1vBqQ6gqzsM2vXtAegtArLb0dpYe_oBRu4pnLbyJuepjofL0ttGcfQ_d_q5f4Ew May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: d440db1af37449b1a5d268506dc5bf11 May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-VolumesNegativeTest-1893086314 May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:12:35.685321 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:12:35.686943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d440db1af37449b1a5d268506dc5bf11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d440db1af37449b1a5d268506dc5bf11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d440db1af37449b1a5d268506dc5bf11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d440db1af37449b1a5d268506dc5bf11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:12:35.686943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-VolumesNegativeTest-1893086314 May 17 17:12:35.686943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: d440db1af37449b1a5d268506dc5bf11 May 17 17:12:35.686943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-VolumesNegativeTest-1893086314 May 17 17:12:35.686943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-VolumesNegativeTest-1893086314-project May 17 17:12:35.686943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:12:35.686943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:12:35.686943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: c7e15f0e588042df9a7502c9f8d50479 May 17 17:12:35.686943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-VolumesNegativeTest-1893086314-project May 17 17:12:35.686943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:12:35.686943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance 1127edfe-a0d6-403d-b83d-e7b55dba4cbf could not be found. May 17 17:12:35.686943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': '1127edfe-a0d6-403d-b83d-e7b55dba4cbf'} May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1127edfe-a0d6-403d-b83d-e7b55dba4cbf could not be found. May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:12:35.688350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1127edfe-a0d6-403d-b83d-e7b55dba4cbf could not be found. May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1127edfe-a0d6-403d-b83d-e7b55dba4cbf could not be found. May 17 17:12:35.690966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:12:35.693356 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-80a7cd4a-e8a6-4001-9dff-7ae374426d08 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] Returning 404 to user: Instance 1127edfe-a0d6-403d-b83d-e7b55dba4cbf could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:12:35.701174 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-80a7cd4a-e8a6-4001-9dff-7ae374426d08 tempest-VolumesNegativeTest-1893086314 tempest-VolumesNegativeTest-1893086314-project] 10.222.0.48 "GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf" status: 404 len: 111 microversion: 2.1 time: 0.044771 May 17 17:12:35.702388 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 171/359] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:35 2022] GET /compute/v2.1/servers/1127edfe-a0d6-403d-b83d-e7b55dba4cbf => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:12:35.901784 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-46f672e0-087c-479b-954b-791e6a3a9416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:35.902953 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-46f672e0-087c-479b-954b-791e6a3a9416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:35.904673 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-763590487", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8fd1f2f-e54a-4844-8483-0ddae8800cdb"}], "security_groups": [{"name": "tempest-securitygroup--1710241352"}], "key_name": "tempest-keypair-305926274", "user_data": "}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:35.909925 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-46f672e0-087c-479b-954b-791e6a3a9416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:35.910624 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-46f672e0-087c-479b-954b-791e6a3a9416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:35.912635 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-46f672e0-087c-479b-954b-791e6a3a9416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:35.913628 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-46f672e0-087c-479b-954b-791e6a3a9416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:36.057555 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-46f672e0-087c-479b-954b-791e6a3a9416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:36.067532 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-46f672e0-087c-479b-954b-791e6a3a9416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:36.069051 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-46f672e0-087c-479b-954b-791e6a3a9416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:36.070195 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-46f672e0-087c-479b-954b-791e6a3a9416 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.172672 May 17 17:12:36.070820 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 189/360] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:35 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:36.624633 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c7afc0dc-0b0f-45e9-9200-7bd4f1d3cc2d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:36.625243 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c7afc0dc-0b0f-45e9-9200-7bd4f1d3cc2d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:36.632408 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c7afc0dc-0b0f-45e9-9200-7bd4f1d3cc2d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:36.632880 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c7afc0dc-0b0f-45e9-9200-7bd4f1d3cc2d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:36.634014 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c7afc0dc-0b0f-45e9-9200-7bd4f1d3cc2d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:36.634454 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c7afc0dc-0b0f-45e9-9200-7bd4f1d3cc2d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:36.777208 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c7afc0dc-0b0f-45e9-9200-7bd4f1d3cc2d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:36.786484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c7afc0dc-0b0f-45e9-9200-7bd4f1d3cc2d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.165639 May 17 17:12:36.787291 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 190/361] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:36 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:37.088924 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-6587ea24-9107-4da9-ba30-c148d85c8235 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:37.089565 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-6587ea24-9107-4da9-ba30-c148d85c8235 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:37.096131 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6587ea24-9107-4da9-ba30-c148d85c8235 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:37.096641 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6587ea24-9107-4da9-ba30-c148d85c8235 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:37.097387 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6587ea24-9107-4da9-ba30-c148d85c8235 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:37.098346 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6587ea24-9107-4da9-ba30-c148d85c8235 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:37.235949 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-6587ea24-9107-4da9-ba30-c148d85c8235 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:37.247950 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-6587ea24-9107-4da9-ba30-c148d85c8235 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:37.249742 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-6587ea24-9107-4da9-ba30-c148d85c8235 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:37.251112 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-6587ea24-9107-4da9-ba30-c148d85c8235 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.166110 May 17 17:12:37.251691 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 191/362] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:37 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:37.812056 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f7737bf9-100c-4452-a92c-f38ed39837d0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:37.813020 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f7737bf9-100c-4452-a92c-f38ed39837d0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:37.829414 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f7737bf9-100c-4452-a92c-f38ed39837d0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:37.831120 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f7737bf9-100c-4452-a92c-f38ed39837d0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:37.832642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f7737bf9-100c-4452-a92c-f38ed39837d0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:37.833916 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f7737bf9-100c-4452-a92c-f38ed39837d0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:38.062162 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f7737bf9-100c-4452-a92c-f38ed39837d0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:38.077346 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f7737bf9-100c-4452-a92c-f38ed39837d0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.274866 May 17 17:12:38.087693 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 192/363] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:37 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:38.272163 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7749c1d0-f9fa-4691-9fc8-0590b8a40b41 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:38.272825 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7749c1d0-f9fa-4691-9fc8-0590b8a40b41 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:38.288189 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7749c1d0-f9fa-4691-9fc8-0590b8a40b41 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:38.288960 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7749c1d0-f9fa-4691-9fc8-0590b8a40b41 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:38.289854 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7749c1d0-f9fa-4691-9fc8-0590b8a40b41 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:38.290707 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7749c1d0-f9fa-4691-9fc8-0590b8a40b41 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:38.451465 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7749c1d0-f9fa-4691-9fc8-0590b8a40b41 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:38.467901 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7749c1d0-f9fa-4691-9fc8-0590b8a40b41 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:38.469382 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7749c1d0-f9fa-4691-9fc8-0590b8a40b41 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:38.471373 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7749c1d0-f9fa-4691-9fc8-0590b8a40b41 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.203779 May 17 17:12:38.472231 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 193/364] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:38 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:39.096694 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-293971c3-de52-4f3a-94ec-e5114a3fa472 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:39.097590 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-293971c3-de52-4f3a-94ec-e5114a3fa472 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:39.105536 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-293971c3-de52-4f3a-94ec-e5114a3fa472 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:39.105932 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-293971c3-de52-4f3a-94ec-e5114a3fa472 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:39.106757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-293971c3-de52-4f3a-94ec-e5114a3fa472 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:39.107646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-293971c3-de52-4f3a-94ec-e5114a3fa472 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:39.254390 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-293971c3-de52-4f3a-94ec-e5114a3fa472 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:39.262523 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-293971c3-de52-4f3a-94ec-e5114a3fa472 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.170578 May 17 17:12:39.263091 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 194/365] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:39 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:39.490880 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f54721bb-97b4-4cef-8615-f6ae0bafe18f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:39.491481 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f54721bb-97b4-4cef-8615-f6ae0bafe18f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:39.497701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f54721bb-97b4-4cef-8615-f6ae0bafe18f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:39.498158 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f54721bb-97b4-4cef-8615-f6ae0bafe18f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:39.498947 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f54721bb-97b4-4cef-8615-f6ae0bafe18f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:39.499384 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f54721bb-97b4-4cef-8615-f6ae0bafe18f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:39.698373 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f54721bb-97b4-4cef-8615-f6ae0bafe18f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:39.708849 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f54721bb-97b4-4cef-8615-f6ae0bafe18f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:39.710468 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f54721bb-97b4-4cef-8615-f6ae0bafe18f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:39.711936 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f54721bb-97b4-4cef-8615-f6ae0bafe18f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.225622 May 17 17:12:39.724095 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 195/366] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:39 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:40.281566 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-332aefcd-aa81-4293-bad5-4251416f604b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:40.282276 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-332aefcd-aa81-4293-bad5-4251416f604b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:40.290075 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-332aefcd-aa81-4293-bad5-4251416f604b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:40.290560 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-332aefcd-aa81-4293-bad5-4251416f604b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:40.291391 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-332aefcd-aa81-4293-bad5-4251416f604b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:40.291882 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-332aefcd-aa81-4293-bad5-4251416f604b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:40.650828 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-332aefcd-aa81-4293-bad5-4251416f604b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:40.659440 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-332aefcd-aa81-4293-bad5-4251416f604b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.382059 May 17 17:12:40.660051 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 196/367] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:40 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:40.731888 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-246f262d-1e84-4fc3-a689-95e4788b3af6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:40.732585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-246f262d-1e84-4fc3-a689-95e4788b3af6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:40.740503 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-246f262d-1e84-4fc3-a689-95e4788b3af6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:40.741045 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-246f262d-1e84-4fc3-a689-95e4788b3af6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:40.741819 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-246f262d-1e84-4fc3-a689-95e4788b3af6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:40.742262 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-246f262d-1e84-4fc3-a689-95e4788b3af6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:40.878638 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-246f262d-1e84-4fc3-a689-95e4788b3af6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:40.888164 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-246f262d-1e84-4fc3-a689-95e4788b3af6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:40.889950 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-246f262d-1e84-4fc3-a689-95e4788b3af6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:40.891090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-246f262d-1e84-4fc3-a689-95e4788b3af6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.163332 May 17 17:12:40.905495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 197/368] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:40 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:12:41.678877 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7833a368-1f52-4d79-b31a-4bef079b4139 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:41.680552 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7833a368-1f52-4d79-b31a-4bef079b4139 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:41.687428 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7833a368-1f52-4d79-b31a-4bef079b4139 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:41.688272 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7833a368-1f52-4d79-b31a-4bef079b4139 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:41.689275 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7833a368-1f52-4d79-b31a-4bef079b4139 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:41.689859 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7833a368-1f52-4d79-b31a-4bef079b4139 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:41.829499 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7833a368-1f52-4d79-b31a-4bef079b4139 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:41.838474 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7833a368-1f52-4d79-b31a-4bef079b4139 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.163561 May 17 17:12:41.839031 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 198/369] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:41 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:41.914487 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a47d73c7-f48c-4000-b323-5bab475f0725 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:41.915054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a47d73c7-f48c-4000-b323-5bab475f0725 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:41.921418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a47d73c7-f48c-4000-b323-5bab475f0725 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:41.921875 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a47d73c7-f48c-4000-b323-5bab475f0725 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:41.922650 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a47d73c7-f48c-4000-b323-5bab475f0725 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:41.923141 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a47d73c7-f48c-4000-b323-5bab475f0725 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:42.057352 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a47d73c7-f48c-4000-b323-5bab475f0725 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:42.065203 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a47d73c7-f48c-4000-b323-5bab475f0725 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:42.066642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a47d73c7-f48c-4000-b323-5bab475f0725 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:42.067814 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a47d73c7-f48c-4000-b323-5bab475f0725 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.157966 May 17 17:12:42.068384 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 199/370] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:41 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:42.856937 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ec5ad2e2-18b5-4c68-b5d4-842b0a2acf08 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:42.857572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ec5ad2e2-18b5-4c68-b5d4-842b0a2acf08 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:42.865433 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ec5ad2e2-18b5-4c68-b5d4-842b0a2acf08 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:42.865875 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ec5ad2e2-18b5-4c68-b5d4-842b0a2acf08 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:42.866703 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ec5ad2e2-18b5-4c68-b5d4-842b0a2acf08 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:42.867835 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ec5ad2e2-18b5-4c68-b5d4-842b0a2acf08 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:43.012503 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ec5ad2e2-18b5-4c68-b5d4-842b0a2acf08 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:43.021493 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ec5ad2e2-18b5-4c68-b5d4-842b0a2acf08 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.168694 May 17 17:12:43.022263 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 200/371] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:42 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:43.086601 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-283eba2d-b2b6-4a80-8051-52458d68f124 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:43.087211 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-283eba2d-b2b6-4a80-8051-52458d68f124 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:43.094137 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-283eba2d-b2b6-4a80-8051-52458d68f124 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:43.094941 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-283eba2d-b2b6-4a80-8051-52458d68f124 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:43.096029 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-283eba2d-b2b6-4a80-8051-52458d68f124 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:43.096566 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-283eba2d-b2b6-4a80-8051-52458d68f124 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:43.248966 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-283eba2d-b2b6-4a80-8051-52458d68f124 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:43.257477 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-283eba2d-b2b6-4a80-8051-52458d68f124 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:43.258974 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-283eba2d-b2b6-4a80-8051-52458d68f124 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:43.260149 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-283eba2d-b2b6-4a80-8051-52458d68f124 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.177922 May 17 17:12:43.260703 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 201/372] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:43 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:12:44.038981 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ed9b652c-f647-4840-82e7-b4c6f5329930 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:44.039645 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ed9b652c-f647-4840-82e7-b4c6f5329930 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:44.046154 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ed9b652c-f647-4840-82e7-b4c6f5329930 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:44.046600 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ed9b652c-f647-4840-82e7-b4c6f5329930 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:44.047382 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ed9b652c-f647-4840-82e7-b4c6f5329930 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:44.047863 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ed9b652c-f647-4840-82e7-b4c6f5329930 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:44.190822 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ed9b652c-f647-4840-82e7-b4c6f5329930 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:44.198967 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ed9b652c-f647-4840-82e7-b4c6f5329930 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.164354 May 17 17:12:44.199843 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 202/373] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:44 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:44.278965 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9da1e1b0-9c5f-46c2-ba1d-2a9742142e92 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:44.280129 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9da1e1b0-9c5f-46c2-ba1d-2a9742142e92 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:44.288148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9da1e1b0-9c5f-46c2-ba1d-2a9742142e92 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:44.288649 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9da1e1b0-9c5f-46c2-ba1d-2a9742142e92 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:44.289647 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9da1e1b0-9c5f-46c2-ba1d-2a9742142e92 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:44.290118 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9da1e1b0-9c5f-46c2-ba1d-2a9742142e92 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:44.440122 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9da1e1b0-9c5f-46c2-ba1d-2a9742142e92 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:44.449217 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9da1e1b0-9c5f-46c2-ba1d-2a9742142e92 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:44.450709 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9da1e1b0-9c5f-46c2-ba1d-2a9742142e92 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:44.451884 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9da1e1b0-9c5f-46c2-ba1d-2a9742142e92 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.177410 May 17 17:12:44.462183 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 203/374] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:44 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:12:45.221533 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f787bd6f-afb1-4114-b1b5-43203fa993e9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:45.222247 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f787bd6f-afb1-4114-b1b5-43203fa993e9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:45.229374 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f787bd6f-afb1-4114-b1b5-43203fa993e9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:45.229813 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f787bd6f-afb1-4114-b1b5-43203fa993e9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:45.230598 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f787bd6f-afb1-4114-b1b5-43203fa993e9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:45.231037 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f787bd6f-afb1-4114-b1b5-43203fa993e9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:45.391701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f787bd6f-afb1-4114-b1b5-43203fa993e9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:45.405178 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f787bd6f-afb1-4114-b1b5-43203fa993e9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.189366 May 17 17:12:45.406034 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 204/375] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:45 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:45.470270 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e240aa4d-63d1-4150-b0fa-20d56d0ace5f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:45.470874 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-e240aa4d-63d1-4150-b0fa-20d56d0ace5f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:45.478331 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e240aa4d-63d1-4150-b0fa-20d56d0ace5f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:45.479122 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e240aa4d-63d1-4150-b0fa-20d56d0ace5f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:45.480093 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e240aa4d-63d1-4150-b0fa-20d56d0ace5f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:45.480692 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e240aa4d-63d1-4150-b0fa-20d56d0ace5f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:45.628058 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-e240aa4d-63d1-4150-b0fa-20d56d0ace5f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:45.636236 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-e240aa4d-63d1-4150-b0fa-20d56d0ace5f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:45.637686 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-e240aa4d-63d1-4150-b0fa-20d56d0ace5f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:45.638848 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e240aa4d-63d1-4150-b0fa-20d56d0ace5f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.172539 May 17 17:12:45.639489 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 205/376] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:45 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:12:46.422715 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7165e3f2-4115-4304-b8d4-58e99849d384 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:46.424003 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7165e3f2-4115-4304-b8d4-58e99849d384 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:46.431511 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7165e3f2-4115-4304-b8d4-58e99849d384 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:46.432100 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7165e3f2-4115-4304-b8d4-58e99849d384 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:46.433015 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7165e3f2-4115-4304-b8d4-58e99849d384 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:46.433555 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7165e3f2-4115-4304-b8d4-58e99849d384 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:46.467446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] validate_networks() for [('d8fd1f2f-e54a-4844-8483-0ddae8800cdb', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:12:46.656541 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7165e3f2-4115-4304-b8d4-58e99849d384 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:46.665052 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7165e3f2-4115-4304-b8d4-58e99849d384 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.246027 May 17 17:12:46.671645 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 206/377] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:46 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:46.671645 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-53840505-c1a7-49ce-8f2d-448fa5e0d286 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:46.671645 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-53840505-c1a7-49ce-8f2d-448fa5e0d286 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:46.676795 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-53840505-c1a7-49ce-8f2d-448fa5e0d286 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:46.677250 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-53840505-c1a7-49ce-8f2d-448fa5e0d286 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:46.678017 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-53840505-c1a7-49ce-8f2d-448fa5e0d286 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:46.678449 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-53840505-c1a7-49ce-8f2d-448fa5e0d286 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:46.880812 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-53840505-c1a7-49ce-8f2d-448fa5e0d286 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:46.889108 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-53840505-c1a7-49ce-8f2d-448fa5e0d286 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:46.890786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-53840505-c1a7-49ce-8f2d-448fa5e0d286 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:46.892574 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-53840505-c1a7-49ce-8f2d-448fa5e0d286 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.225080 May 17 17:12:46.903673 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 207/378] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:46 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:47.011949 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:12:47.012365 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:12:47.012833 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:12:47.013235 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:12:47.013644 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:12:47.023015 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:47.023392 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:47.024209 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:47.024639 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:47.044313 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Getting quotas for project ea3305a913c541e4a45267497213df1c. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:12:47.048530 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Getting quotas for user 824915e26a724d938e5dd0a3c1f57932 and project ea3305a913c541e4a45267497213df1c. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:12:47.065107 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:12:47.067421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:12:47.115843 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d4177402-8a7d-4f44-aaf1-b973913a5bc3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 11.215890 May 17 17:12:47.116834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 172/379] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:12:35 2022] POST /compute/v2.1/servers => generated 409 bytes in 11217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:12:47.127112 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-286f9daa-6c7a-495b-add0-215dbd9325de tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:47.127960 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-286f9daa-6c7a-495b-add0-215dbd9325de tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:47.185723 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-286f9daa-6c7a-495b-add0-215dbd9325de tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:47.193576 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-286f9daa-6c7a-495b-add0-215dbd9325de tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1244 microversion: 2.1 time: 0.070211 May 17 17:12:47.194475 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 208/380] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:47 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1244 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:47.682729 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4d28ea0c-2976-4e52-8bd9-4d801c12c454 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:47.683463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4d28ea0c-2976-4e52-8bd9-4d801c12c454 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:47.690679 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4d28ea0c-2976-4e52-8bd9-4d801c12c454 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:47.691132 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4d28ea0c-2976-4e52-8bd9-4d801c12c454 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:47.692009 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4d28ea0c-2976-4e52-8bd9-4d801c12c454 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:47.692506 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4d28ea0c-2976-4e52-8bd9-4d801c12c454 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:47.828844 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4d28ea0c-2976-4e52-8bd9-4d801c12c454 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:47.838374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4d28ea0c-2976-4e52-8bd9-4d801c12c454 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1723 microversion: 2.1 time: 0.160070 May 17 17:12:47.839022 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 173/381] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:47 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:47.910339 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1191096d-9397-4bd5-9f8f-d9ed04769472 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:47.911451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1191096d-9397-4bd5-9f8f-d9ed04769472 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:47.917734 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1191096d-9397-4bd5-9f8f-d9ed04769472 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:47.918187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1191096d-9397-4bd5-9f8f-d9ed04769472 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:47.918954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1191096d-9397-4bd5-9f8f-d9ed04769472 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:47.919392 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1191096d-9397-4bd5-9f8f-d9ed04769472 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:48.057094 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1191096d-9397-4bd5-9f8f-d9ed04769472 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:48.065892 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1191096d-9397-4bd5-9f8f-d9ed04769472 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:48.067489 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1191096d-9397-4bd5-9f8f-d9ed04769472 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:48.068869 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1191096d-9397-4bd5-9f8f-d9ed04769472 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.162688 May 17 17:12:48.069516 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 209/382] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:47 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:48.210083 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-57550950-cbb2-4b06-9094-21f671aabf9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:48.210733 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-57550950-cbb2-4b06-9094-21f671aabf9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:48.217003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-57550950-cbb2-4b06-9094-21f671aabf9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:48.217459 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-57550950-cbb2-4b06-9094-21f671aabf9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:48.219541 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-57550950-cbb2-4b06-9094-21f671aabf9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:48.220697 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-57550950-cbb2-4b06-9094-21f671aabf9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:48.296974 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-57550950-cbb2-4b06-9094-21f671aabf9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:48.308811 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-57550950-cbb2-4b06-9094-21f671aabf9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1248 microversion: 2.1 time: 0.102449 May 17 17:12:48.309382 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 174/383] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:48 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1248 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:48.855752 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-bfdb175c-ac4f-4b08-818c-b535128bf76c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:48.856276 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-bfdb175c-ac4f-4b08-818c-b535128bf76c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:48.862471 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bfdb175c-ac4f-4b08-818c-b535128bf76c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:48.862915 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bfdb175c-ac4f-4b08-818c-b535128bf76c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:48.863708 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bfdb175c-ac4f-4b08-818c-b535128bf76c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:48.864145 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bfdb175c-ac4f-4b08-818c-b535128bf76c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:48.999202 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-bfdb175c-ac4f-4b08-818c-b535128bf76c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:49.013159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-bfdb175c-ac4f-4b08-818c-b535128bf76c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1700 microversion: 2.1 time: 0.160840 May 17 17:12:49.014574 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 210/384] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:48 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1700 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:49.034399 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2339b6b8-f85f-4114-9449-49292159a005 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:49.041093 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2339b6b8-f85f-4114-9449-49292159a005 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:49.041579 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2339b6b8-f85f-4114-9449-49292159a005 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:49.067091 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2339b6b8-f85f-4114-9449-49292159a005 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Going to try to start instance {{(pid=117089) start /opt/stack/nova/nova/compute/api.py:2730}} May 17 17:12:49.087146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2a107a45-2664-46ad-bfa4-0fc2ff35ee31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:49.087790 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2a107a45-2664-46ad-bfa4-0fc2ff35ee31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:49.096689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2a107a45-2664-46ad-bfa4-0fc2ff35ee31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:49.096689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2a107a45-2664-46ad-bfa4-0fc2ff35ee31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:49.097852 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2a107a45-2664-46ad-bfa4-0fc2ff35ee31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:49.098386 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2a107a45-2664-46ad-bfa4-0fc2ff35ee31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:49.116119 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2339b6b8-f85f-4114-9449-49292159a005 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "POST /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/action" status: 202 len: 0 microversion: 2.1 time: 0.087481 May 17 17:12:49.116798 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 175/385] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 17 17:12:49 2022] POST /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:12:49.125088 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f3b4ecbf-c85d-4087-8ec9-27c0dbf2e387 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:49.126759 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f3b4ecbf-c85d-4087-8ec9-27c0dbf2e387 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:49.140494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f3b4ecbf-c85d-4087-8ec9-27c0dbf2e387 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:49.141234 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f3b4ecbf-c85d-4087-8ec9-27c0dbf2e387 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:49.145953 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f3b4ecbf-c85d-4087-8ec9-27c0dbf2e387 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:49.146938 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f3b4ecbf-c85d-4087-8ec9-27c0dbf2e387 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:49.322828 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2a107a45-2664-46ad-bfa4-0fc2ff35ee31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:49.336871 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2a107a45-2664-46ad-bfa4-0fc2ff35ee31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:49.339424 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2a107a45-2664-46ad-bfa4-0fc2ff35ee31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:49.339698 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f3b4ecbf-c85d-4087-8ec9-27c0dbf2e387 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:49.341045 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2a107a45-2664-46ad-bfa4-0fc2ff35ee31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.257685 May 17 17:12:49.341837 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 211/386] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:49 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:49.346802 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-28d4ca1d-f719-4e9c-a90d-6696f8479869 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:49.347668 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-28d4ca1d-f719-4e9c-a90d-6696f8479869 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:49.350534 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f3b4ecbf-c85d-4087-8ec9-27c0dbf2e387 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1709 microversion: 2.1 time: 0.229386 May 17 17:12:49.351306 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 176/387] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:49 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1709 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:49.359344 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-28d4ca1d-f719-4e9c-a90d-6696f8479869 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:49.359831 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-28d4ca1d-f719-4e9c-a90d-6696f8479869 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:49.361179 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-28d4ca1d-f719-4e9c-a90d-6696f8479869 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:49.361646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-28d4ca1d-f719-4e9c-a90d-6696f8479869 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:49.426592 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-28d4ca1d-f719-4e9c-a90d-6696f8479869 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:49.434145 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-28d4ca1d-f719-4e9c-a90d-6696f8479869 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1296 microversion: 2.1 time: 0.091012 May 17 17:12:49.434648 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 212/388] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:49 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1296 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:50.360990 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-eb486cf6-bf16-43f6-b5dc-960d1d05ba7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:50.362959 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-eb486cf6-bf16-43f6-b5dc-960d1d05ba7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:50.371037 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1f20d6fb-00a9-4b52-ba50-f998702417bd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:50.371821 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1f20d6fb-00a9-4b52-ba50-f998702417bd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:50.393670 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f20d6fb-00a9-4b52-ba50-f998702417bd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:50.395809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f20d6fb-00a9-4b52-ba50-f998702417bd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:50.396799 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f20d6fb-00a9-4b52-ba50-f998702417bd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:50.399289 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eb486cf6-bf16-43f6-b5dc-960d1d05ba7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:50.400037 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f20d6fb-00a9-4b52-ba50-f998702417bd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:50.403900 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eb486cf6-bf16-43f6-b5dc-960d1d05ba7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:50.406063 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eb486cf6-bf16-43f6-b5dc-960d1d05ba7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:50.406435 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eb486cf6-bf16-43f6-b5dc-960d1d05ba7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:50.683292 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1f20d6fb-00a9-4b52-ba50-f998702417bd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:50.695385 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1f20d6fb-00a9-4b52-ba50-f998702417bd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1709 microversion: 2.1 time: 0.328007 May 17 17:12:50.708741 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 213/389] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:50 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1709 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:50.714075 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b6f45472-2c06-4ef5-ad7c-755fb6e6586a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:50.718336 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b6f45472-2c06-4ef5-ad7c-755fb6e6586a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:50.739144 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-eb486cf6-bf16-43f6-b5dc-960d1d05ba7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:50.741527 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b6f45472-2c06-4ef5-ad7c-755fb6e6586a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:50.741976 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b6f45472-2c06-4ef5-ad7c-755fb6e6586a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:50.742756 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b6f45472-2c06-4ef5-ad7c-755fb6e6586a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:50.743374 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b6f45472-2c06-4ef5-ad7c-755fb6e6586a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:50.758537 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-eb486cf6-bf16-43f6-b5dc-960d1d05ba7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:50.760204 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-eb486cf6-bf16-43f6-b5dc-960d1d05ba7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:50.761922 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-eb486cf6-bf16-43f6-b5dc-960d1d05ba7b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1745 microversion: 2.20 time: 0.405882 May 17 17:12:50.763050 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 177/390] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:50 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1745 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:12:50.826842 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b6f45472-2c06-4ef5-ad7c-755fb6e6586a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:50.836281 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b6f45472-2c06-4ef5-ad7c-755fb6e6586a tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1302 microversion: 2.1 time: 0.126105 May 17 17:12:50.836850 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 214/391] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:50 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1302 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:51.716969 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-964d746a-c192-4a23-9bd6-a2b617362027 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:51.718487 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-964d746a-c192-4a23-9bd6-a2b617362027 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:51.727874 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-964d746a-c192-4a23-9bd6-a2b617362027 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:51.728829 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-964d746a-c192-4a23-9bd6-a2b617362027 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:51.729844 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-964d746a-c192-4a23-9bd6-a2b617362027 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:51.730645 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-964d746a-c192-4a23-9bd6-a2b617362027 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:51.787254 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1caf8884-f7b1-44ed-a632-4246338545f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:51.787901 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1caf8884-f7b1-44ed-a632-4246338545f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:51.801949 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1caf8884-f7b1-44ed-a632-4246338545f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:51.802410 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1caf8884-f7b1-44ed-a632-4246338545f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:51.803164 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1caf8884-f7b1-44ed-a632-4246338545f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:51.803643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1caf8884-f7b1-44ed-a632-4246338545f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:52.006232 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-964d746a-c192-4a23-9bd6-a2b617362027 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:52.016148 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-964d746a-c192-4a23-9bd6-a2b617362027 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1709 microversion: 2.1 time: 0.306725 May 17 17:12:52.017461 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 178/392] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:51 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1709 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:52.023549 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-1e36bac2-78f8-4b4d-b7bc-73e860c5df14 req-33a05c84-6b50-4c8a-99be-f5006d96196a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfa0b8b-6981-43aa-9f5c-214bc3c20d64", "tag": "6b3cb952-d5bd-4de9-965c-39fcdbf9ab21"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:52.042925 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1caf8884-f7b1-44ed-a632-4246338545f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:52.052407 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-1e36bac2-78f8-4b4d-b7bc-73e860c5df14 req-33a05c84-6b50-4c8a-99be-f5006d96196a service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:52.053007 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-1e36bac2-78f8-4b4d-b7bc-73e860c5df14 req-33a05c84-6b50-4c8a-99be-f5006d96196a service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:52.058394 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1caf8884-f7b1-44ed-a632-4246338545f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:52.059937 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1caf8884-f7b1-44ed-a632-4246338545f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:52.062325 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1caf8884-f7b1-44ed-a632-4246338545f6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1745 microversion: 2.20 time: 0.280770 May 17 17:12:52.067458 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-1e36bac2-78f8-4b4d-b7bc-73e860c5df14 req-33a05c84-6b50-4c8a-99be-f5006d96196a service nova] Creating event network-changed:6b3cb952-d5bd-4de9-965c-39fcdbf9ab21 for instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 on hv-cinder-84214 May 17 17:12:52.072854 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-1e36bac2-78f8-4b4d-b7bc-73e860c5df14 req-33a05c84-6b50-4c8a-99be-f5006d96196a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054056 May 17 17:12:52.073436 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 179/393] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:52.075035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 215/394] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:51 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1745 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:52.079673 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-10e2a954-8215-41fa-8028-a4f4c37f30b8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:52.080476 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-10e2a954-8215-41fa-8028-a4f4c37f30b8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:52.096156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-10e2a954-8215-41fa-8028-a4f4c37f30b8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:52.096156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-10e2a954-8215-41fa-8028-a4f4c37f30b8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:52.096942 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-10e2a954-8215-41fa-8028-a4f4c37f30b8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:52.097475 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-10e2a954-8215-41fa-8028-a4f4c37f30b8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:52.243478 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-10e2a954-8215-41fa-8028-a4f4c37f30b8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:52.252599 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-10e2a954-8215-41fa-8028-a4f4c37f30b8 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1370 microversion: 2.1 time: 0.177602 May 17 17:12:52.253250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 180/395] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:52 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:53.023312 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2e65b731-9c36-4154-8c6f-bec169db6e7a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:53.024980 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2e65b731-9c36-4154-8c6f-bec169db6e7a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:53.031483 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2e65b731-9c36-4154-8c6f-bec169db6e7a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:53.031986 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2e65b731-9c36-4154-8c6f-bec169db6e7a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:53.033131 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2e65b731-9c36-4154-8c6f-bec169db6e7a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:53.033571 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2e65b731-9c36-4154-8c6f-bec169db6e7a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:53.035263 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7a11eedf-73f4-45fc-ac60-955b71b234e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:53.036331 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7a11eedf-73f4-45fc-ac60-955b71b234e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:53.049425 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7a11eedf-73f4-45fc-ac60-955b71b234e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:53.049892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7a11eedf-73f4-45fc-ac60-955b71b234e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:53.050689 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7a11eedf-73f4-45fc-ac60-955b71b234e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:53.058061 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7a11eedf-73f4-45fc-ac60-955b71b234e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:53.179719 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-2e65b731-9c36-4154-8c6f-bec169db6e7a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lazy-loading 'services' on Instance uuid 159a856c-1046-429c-91b8-71de1b5adc15 {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:12:53.221042 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7a11eedf-73f4-45fc-ac60-955b71b234e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:53.228863 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7a11eedf-73f4-45fc-ac60-955b71b234e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1713 microversion: 2.1 time: 0.198596 May 17 17:12:53.241115 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 181/396] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:53 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1713 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:53.246910 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6d180fa9-a18d-400f-97b6-092b491ae508 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:53.247624 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6d180fa9-a18d-400f-97b6-092b491ae508 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:53.254635 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d180fa9-a18d-400f-97b6-092b491ae508 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:53.255354 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d180fa9-a18d-400f-97b6-092b491ae508 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:53.256603 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d180fa9-a18d-400f-97b6-092b491ae508 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:53.257277 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d180fa9-a18d-400f-97b6-092b491ae508 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:53.335753 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2e65b731-9c36-4154-8c6f-bec169db6e7a tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "DELETE /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15/os-volume_attachments/35878e28-7d52-4114-8ac5-1f0b95a31305" status: 202 len: 0 microversion: 2.1 time: 0.315740 May 17 17:12:53.337899 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 216/397] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 17 17:12:53 2022] DELETE /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15/os-volume_attachments/35878e28-7d52-4114-8ac5-1f0b95a31305 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:12:53.346964 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-1c2f2560-6017-4c02-a4ae-7d2d1f28b7d3 req-85b6a4d7-ad14-452b-a0af-75329a4482c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b074c961-149b-4667-addc-790568769b88", "name": "network-vif-plugged", "status": "completed", "tag": "e6735ae1-4241-48ca-9802-22aba7b4cccc"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:53.362260 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-1c2f2560-6017-4c02-a4ae-7d2d1f28b7d3 req-85b6a4d7-ad14-452b-a0af-75329a4482c4 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:53.362828 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-1c2f2560-6017-4c02-a4ae-7d2d1f28b7d3 req-85b6a4d7-ad14-452b-a0af-75329a4482c4 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:53.386896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-1c2f2560-6017-4c02-a4ae-7d2d1f28b7d3 req-85b6a4d7-ad14-452b-a0af-75329a4482c4 service nova] Creating event network-vif-plugged:e6735ae1-4241-48ca-9802-22aba7b4cccc for instance b074c961-149b-4667-addc-790568769b88 on hv-cinder-84214 May 17 17:12:53.392923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-1c2f2560-6017-4c02-a4ae-7d2d1f28b7d3 req-85b6a4d7-ad14-452b-a0af-75329a4482c4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052820 May 17 17:12:53.394148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 217/398] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:53.401711 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-08f9c23c-db76-4e68-9427-79743ebc2d31 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:53.402617 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-08f9c23c-db76-4e68-9427-79743ebc2d31 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:53.412876 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-08f9c23c-db76-4e68-9427-79743ebc2d31 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:53.413332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-08f9c23c-db76-4e68-9427-79743ebc2d31 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:53.414260 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-08f9c23c-db76-4e68-9427-79743ebc2d31 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:53.414700 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-08f9c23c-db76-4e68-9427-79743ebc2d31 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:53.464710 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6d180fa9-a18d-400f-97b6-092b491ae508 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:53.474652 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6d180fa9-a18d-400f-97b6-092b491ae508 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:53.476526 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6d180fa9-a18d-400f-97b6-092b491ae508 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:53.477712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6d180fa9-a18d-400f-97b6-092b491ae508 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1745 microversion: 2.20 time: 0.235503 May 17 17:12:53.478269 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 182/399] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:53 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1745 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:53.576283 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-08f9c23c-db76-4e68-9427-79743ebc2d31 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:53.584567 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-08f9c23c-db76-4e68-9427-79743ebc2d31 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1370 microversion: 2.1 time: 0.188927 May 17 17:12:53.585131 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 218/400] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:53 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:54.495876 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-084e511e-4100-491e-8797-11a01668da1f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:54.496504 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-084e511e-4100-491e-8797-11a01668da1f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:54.503181 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-084e511e-4100-491e-8797-11a01668da1f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:54.503644 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-084e511e-4100-491e-8797-11a01668da1f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:54.504402 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-084e511e-4100-491e-8797-11a01668da1f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:54.504856 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-084e511e-4100-491e-8797-11a01668da1f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:54.601224 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b4b8eb62-3ddb-4be6-9c56-a29f3dddc3d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:54.601947 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b4b8eb62-3ddb-4be6-9c56-a29f3dddc3d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:54.608712 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b4b8eb62-3ddb-4be6-9c56-a29f3dddc3d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:54.609169 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b4b8eb62-3ddb-4be6-9c56-a29f3dddc3d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:54.609942 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b4b8eb62-3ddb-4be6-9c56-a29f3dddc3d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:54.610913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b4b8eb62-3ddb-4be6-9c56-a29f3dddc3d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:54.637342 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-084e511e-4100-491e-8797-11a01668da1f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:54.645380 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-084e511e-4100-491e-8797-11a01668da1f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:54.646862 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-084e511e-4100-491e-8797-11a01668da1f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:54.648088 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-084e511e-4100-491e-8797-11a01668da1f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1745 microversion: 2.20 time: 0.156087 May 17 17:12:54.648727 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 183/401] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:54 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:54.740570 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b4b8eb62-3ddb-4be6-9c56-a29f3dddc3d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:54.748157 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b4b8eb62-3ddb-4be6-9c56-a29f3dddc3d7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1370 microversion: 2.1 time: 0.150733 May 17 17:12:54.748917 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 219/402] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:54 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:55.560927 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7fc96f0d-9e23-4096-9697-68a62b821c27 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:55.561433 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7fc96f0d-9e23-4096-9697-68a62b821c27 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:55.568886 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7fc96f0d-9e23-4096-9697-68a62b821c27 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:55.569686 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7fc96f0d-9e23-4096-9697-68a62b821c27 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:55.570786 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7fc96f0d-9e23-4096-9697-68a62b821c27 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:55.571155 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7fc96f0d-9e23-4096-9697-68a62b821c27 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:55.600499 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7fc96f0d-9e23-4096-9697-68a62b821c27 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Going to try to terminate instance {{(pid=117089) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:12:55.685311 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7db1782b-fd09-4ca6-958d-4aac936106d6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:55.686559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7db1782b-fd09-4ca6-958d-4aac936106d6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:55.699300 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7db1782b-fd09-4ca6-958d-4aac936106d6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:55.700116 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7db1782b-fd09-4ca6-958d-4aac936106d6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:55.701101 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7db1782b-fd09-4ca6-958d-4aac936106d6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:55.701767 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7db1782b-fd09-4ca6-958d-4aac936106d6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:55.734401 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7fc96f0d-9e23-4096-9697-68a62b821c27 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "DELETE /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 204 len: 0 microversion: 2.1 time: 0.176968 May 17 17:12:55.736188 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 184/403] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:12:55 2022] DELETE /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:12:55.749336 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-796c7a72-ec3f-4ea7-866c-30bb5968b779 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:55.750563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-796c7a72-ec3f-4ea7-866c-30bb5968b779 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:55.757963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-796c7a72-ec3f-4ea7-866c-30bb5968b779 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:55.758671 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-796c7a72-ec3f-4ea7-866c-30bb5968b779 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:55.760590 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-796c7a72-ec3f-4ea7-866c-30bb5968b779 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:55.761190 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-796c7a72-ec3f-4ea7-866c-30bb5968b779 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:55.918176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7db1782b-fd09-4ca6-958d-4aac936106d6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:55.927347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7db1782b-fd09-4ca6-958d-4aac936106d6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:55.932530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7db1782b-fd09-4ca6-958d-4aac936106d6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:55.933726 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7db1782b-fd09-4ca6-958d-4aac936106d6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1740 microversion: 2.20 time: 0.254332 May 17 17:12:55.934278 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 220/404] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:55 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1740 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:55.940863 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a7ba1e62-f44d-4373-a223-5cfcb594087c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:55.942032 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a7ba1e62-f44d-4373-a223-5cfcb594087c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:55.949940 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a7ba1e62-f44d-4373-a223-5cfcb594087c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:55.950658 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a7ba1e62-f44d-4373-a223-5cfcb594087c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:55.952385 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a7ba1e62-f44d-4373-a223-5cfcb594087c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:55.953227 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a7ba1e62-f44d-4373-a223-5cfcb594087c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:55.989708 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-796c7a72-ec3f-4ea7-866c-30bb5968b779 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:56.000484 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-796c7a72-ec3f-4ea7-866c-30bb5968b779 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1513 microversion: 2.1 time: 0.257837 May 17 17:12:56.010714 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 185/405] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:55 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1513 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:56.098770 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a7ba1e62-f44d-4373-a223-5cfcb594087c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:56.106448 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a7ba1e62-f44d-4373-a223-5cfcb594087c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1370 microversion: 2.1 time: 0.170965 May 17 17:12:56.107187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 221/406] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:55 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:56.545609 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-364441380", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1446987121", "security_groups": [{"name": "tempest-secgroup-smoke-900031138"}], "networks": [{"uuid": "fac7d240-6e72-4e7e-a11f-51c520d02d21"}], "block_device_mapping_v2": [{"uuid": "30347adb-6f7c-4154-99b7-8515b440272b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:56.677894 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] validate_networks() for [('fac7d240-6e72-4e7e-a11f-51c520d02d21', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:12:56.966149 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b37496cd-1069-4717-8ff9-947a9e84a0cb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:56.968578 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b37496cd-1069-4717-8ff9-947a9e84a0cb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:56.987022 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b37496cd-1069-4717-8ff9-947a9e84a0cb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:56.987843 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b37496cd-1069-4717-8ff9-947a9e84a0cb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:56.988934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b37496cd-1069-4717-8ff9-947a9e84a0cb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:56.990067 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b37496cd-1069-4717-8ff9-947a9e84a0cb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:57.185721 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b37496cd-1069-4717-8ff9-947a9e84a0cb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:57.200670 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b37496cd-1069-4717-8ff9-947a9e84a0cb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:57.202553 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b37496cd-1069-4717-8ff9-947a9e84a0cb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:57.203317 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:12:57.203912 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:12:57.204398 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:12:57.204814 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:12:57.205237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:12:57.205967 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b37496cd-1069-4717-8ff9-947a9e84a0cb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1740 microversion: 2.20 time: 0.256568 May 17 17:12:57.208138 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 222/407] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:56 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:12:57.213205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a288cbb0-bcdf-46af-acb7-888330158aba tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:57.220097 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a288cbb0-bcdf-46af-acb7-888330158aba tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:57.226228 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:57.226688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:57.227495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:57.227963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:57.236687 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a288cbb0-bcdf-46af-acb7-888330158aba tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:57.237394 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a288cbb0-bcdf-46af-acb7-888330158aba tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:57.239438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a288cbb0-bcdf-46af-acb7-888330158aba tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:57.240088 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a288cbb0-bcdf-46af-acb7-888330158aba tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:57.251782 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Getting quotas for project 2630e0044e5f4f28b8d2adcfeaf0c604. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:12:57.257832 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Getting quotas for user 4302f72c503341d4a5367613edf38055 and project 2630e0044e5f4f28b8d2adcfeaf0c604. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:12:57.346633 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:12:57.349097 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='30347adb-6f7c-4154-99b7-8515b440272b',volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:12:57.452604 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a288cbb0-bcdf-46af-acb7-888330158aba tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:57.461504 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a288cbb0-bcdf-46af-acb7-888330158aba tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1513 microversion: 2.1 time: 0.251753 May 17 17:12:57.464087 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 223/408] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:57 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1513 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:57.468915 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c1649147-014d-4db7-9a32-9935e3860551 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:57.470474 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c1649147-014d-4db7-9a32-9935e3860551 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:57.477594 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c1649147-014d-4db7-9a32-9935e3860551 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:57.478288 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c1649147-014d-4db7-9a32-9935e3860551 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:57.479285 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c1649147-014d-4db7-9a32-9935e3860551 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:57.479996 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c1649147-014d-4db7-9a32-9935e3860551 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:57.542619 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6cb2b21e-d913-4a0c-ae77-dbadc30c8584 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.003009 May 17 17:12:57.543525 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 186/409] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:12:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:12:57.554912 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-b22197f1-85b6-4470-988d-126a5d590916 req-04bb05b5-dd76-4a7b-ae83-490270bb7442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfa0b8b-6981-43aa-9f5c-214bc3c20d64", "name": "network-vif-plugged", "status": "completed", "tag": "6b3cb952-d5bd-4de9-965c-39fcdbf9ab21"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:57.566257 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-b22197f1-85b6-4470-988d-126a5d590916 req-04bb05b5-dd76-4a7b-ae83-490270bb7442 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:57.567099 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-b22197f1-85b6-4470-988d-126a5d590916 req-04bb05b5-dd76-4a7b-ae83-490270bb7442 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:57.584680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-b22197f1-85b6-4470-988d-126a5d590916 req-04bb05b5-dd76-4a7b-ae83-490270bb7442 service nova] Creating event network-vif-plugged:6b3cb952-d5bd-4de9-965c-39fcdbf9ab21 for instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 on hv-cinder-84214 May 17 17:12:57.590086 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-b22197f1-85b6-4470-988d-126a5d590916 req-04bb05b5-dd76-4a7b-ae83-490270bb7442 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040773 May 17 17:12:57.591033 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 187/410] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:57.605083 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ea91ea61-06bc-4f56-89fb-a03955b72a0b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:57.606141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ea91ea61-06bc-4f56-89fb-a03955b72a0b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:57.704406 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ea91ea61-06bc-4f56-89fb-a03955b72a0b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:57.713231 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c1649147-014d-4db7-9a32-9935e3860551 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:57.713765 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ea91ea61-06bc-4f56-89fb-a03955b72a0b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1088 microversion: 2.1 time: 0.121219 May 17 17:12:57.716804 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 188/411] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:57 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1088 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:57.742950 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c1649147-014d-4db7-9a32-9935e3860551 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1370 microversion: 2.1 time: 0.276381 May 17 17:12:57.744099 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 224/412] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:57 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1370 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:58.228191 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-68f6934b-5648-45f7-b060-cd5e481238e0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:58.229068 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-68f6934b-5648-45f7-b060-cd5e481238e0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:58.241061 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-68f6934b-5648-45f7-b060-cd5e481238e0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:58.241556 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-68f6934b-5648-45f7-b060-cd5e481238e0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:58.242614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-68f6934b-5648-45f7-b060-cd5e481238e0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:58.243393 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-68f6934b-5648-45f7-b060-cd5e481238e0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:58.480817 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8790d788-b2cf-4e7e-ad5f-7038faf435ca tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:58.482169 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8790d788-b2cf-4e7e-ad5f-7038faf435ca tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:58.489261 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8790d788-b2cf-4e7e-ad5f-7038faf435ca tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:58.499288 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8790d788-b2cf-4e7e-ad5f-7038faf435ca tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:58.502683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8790d788-b2cf-4e7e-ad5f-7038faf435ca tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:58.505855 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8790d788-b2cf-4e7e-ad5f-7038faf435ca tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:58.569672 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-68f6934b-5648-45f7-b060-cd5e481238e0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:58.584491 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-68f6934b-5648-45f7-b060-cd5e481238e0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:58.597557 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-68f6934b-5648-45f7-b060-cd5e481238e0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:58.599246 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-68f6934b-5648-45f7-b060-cd5e481238e0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1740 microversion: 2.20 time: 0.376168 May 17 17:12:58.610444 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 189/413] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:58 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1740 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:58.737532 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-29e34294-c9a9-4d7d-bde8-6bdb91527524 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:58.738847 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-29e34294-c9a9-4d7d-bde8-6bdb91527524 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:58.746831 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29e34294-c9a9-4d7d-bde8-6bdb91527524 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:58.747302 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29e34294-c9a9-4d7d-bde8-6bdb91527524 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:58.748256 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29e34294-c9a9-4d7d-bde8-6bdb91527524 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:58.748911 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29e34294-c9a9-4d7d-bde8-6bdb91527524 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:58.783413 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8790d788-b2cf-4e7e-ad5f-7038faf435ca tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:58.803371 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8790d788-b2cf-4e7e-ad5f-7038faf435ca tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1513 microversion: 2.1 time: 0.326254 May 17 17:12:58.804180 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 225/414] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:58 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1513 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:58.819228 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a0452f43-b7a7-40c9-a670-8eb39f38eeb4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:58.819892 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a0452f43-b7a7-40c9-a670-8eb39f38eeb4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:58.825970 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a0452f43-b7a7-40c9-a670-8eb39f38eeb4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:58.826568 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a0452f43-b7a7-40c9-a670-8eb39f38eeb4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:58.827643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a0452f43-b7a7-40c9-a670-8eb39f38eeb4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:58.828210 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a0452f43-b7a7-40c9-a670-8eb39f38eeb4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:58.839077 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-29e34294-c9a9-4d7d-bde8-6bdb91527524 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:58.859117 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-29e34294-c9a9-4d7d-bde8-6bdb91527524 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1186 microversion: 2.1 time: 0.125903 May 17 17:12:58.859741 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 190/415] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:58 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1186 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:12:59.018531 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a0452f43-b7a7-40c9-a670-8eb39f38eeb4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:59.028333 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a0452f43-b7a7-40c9-a670-8eb39f38eeb4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1370 microversion: 2.1 time: 0.222325 May 17 17:12:59.033798 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 226/416] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:58 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:12:59.162005 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-0dad4d22-7ba9-4d82-8cf0-2e4ab06c6e0d req-10e5030a-ee0f-41fb-8136-1ab54e5734a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159a856c-1046-429c-91b8-71de1b5adc15", "name": "network-vif-deleted", "tag": "902521d6-268e-414c-ae53-f1f63273ac65"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:12:59.171186 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-0dad4d22-7ba9-4d82-8cf0-2e4ab06c6e0d req-10e5030a-ee0f-41fb-8136-1ab54e5734a6 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:59.171877 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-0dad4d22-7ba9-4d82-8cf0-2e4ab06c6e0d req-10e5030a-ee0f-41fb-8136-1ab54e5734a6 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:59.186749 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-0dad4d22-7ba9-4d82-8cf0-2e4ab06c6e0d req-10e5030a-ee0f-41fb-8136-1ab54e5734a6 service nova] Creating event network-vif-deleted:902521d6-268e-414c-ae53-f1f63273ac65 for instance 159a856c-1046-429c-91b8-71de1b5adc15 on hv-cinder-84214 May 17 17:12:59.192544 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-0dad4d22-7ba9-4d82-8cf0-2e4ab06c6e0d req-10e5030a-ee0f-41fb-8136-1ab54e5734a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036101 May 17 17:12:59.193132 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 191/417] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:12:59.622278 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-90cb27ff-2e71-4b16-ab61-812a6a7a7fa8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:59.623556 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-90cb27ff-2e71-4b16-ab61-812a6a7a7fa8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:59.630037 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90cb27ff-2e71-4b16-ab61-812a6a7a7fa8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:59.630480 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90cb27ff-2e71-4b16-ab61-812a6a7a7fa8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:59.631244 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90cb27ff-2e71-4b16-ab61-812a6a7a7fa8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:59.631711 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90cb27ff-2e71-4b16-ab61-812a6a7a7fa8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:59.787255 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-90cb27ff-2e71-4b16-ab61-812a6a7a7fa8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:59.799001 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-90cb27ff-2e71-4b16-ab61-812a6a7a7fa8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:59.800552 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-90cb27ff-2e71-4b16-ab61-812a6a7a7fa8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:59.801871 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-90cb27ff-2e71-4b16-ab61-812a6a7a7fa8 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1740 microversion: 2.20 time: 0.188174 May 17 17:12:59.803636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 227/418] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:12:59 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:12:59.822035 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-820b7998-5419-45aa-a266-92d0d81c6f7c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:59.822914 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-820b7998-5419-45aa-a266-92d0d81c6f7c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:59.833511 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-820b7998-5419-45aa-a266-92d0d81c6f7c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:59.834221 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-820b7998-5419-45aa-a266-92d0d81c6f7c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:59.835002 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-820b7998-5419-45aa-a266-92d0d81c6f7c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:59.835441 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-820b7998-5419-45aa-a266-92d0d81c6f7c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:59.878123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c88593d2-0d88-4eff-b348-9879e9a916a8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:59.878123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c88593d2-0d88-4eff-b348-9879e9a916a8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:12:59.889521 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c88593d2-0d88-4eff-b348-9879e9a916a8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:59.889977 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c88593d2-0d88-4eff-b348-9879e9a916a8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:59.890753 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c88593d2-0d88-4eff-b348-9879e9a916a8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:59.891747 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c88593d2-0d88-4eff-b348-9879e9a916a8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:59.930671 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-820b7998-5419-45aa-a266-92d0d81c6f7c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:12:59.955932 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-820b7998-5419-45aa-a266-92d0d81c6f7c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1304 microversion: 2.1 time: 0.136158 May 17 17:12:59.956373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 192/419] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:59 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:00.038901 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c88593d2-0d88-4eff-b348-9879e9a916a8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:00.048778 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7510219d-325e-4f38-8a74-b5c13b425d3c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:00.053728 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7510219d-325e-4f38-8a74-b5c13b425d3c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:00.059491 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c88593d2-0d88-4eff-b348-9879e9a916a8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1186 microversion: 2.1 time: 0.186193 May 17 17:13:00.064830 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7510219d-325e-4f38-8a74-b5c13b425d3c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:00.065492 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7510219d-325e-4f38-8a74-b5c13b425d3c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:00.066443 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7510219d-325e-4f38-8a74-b5c13b425d3c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:00.067050 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7510219d-325e-4f38-8a74-b5c13b425d3c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:00.069741 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 228/420] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:12:59 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1186 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:00.276603 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7510219d-325e-4f38-8a74-b5c13b425d3c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:00.286514 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7510219d-325e-4f38-8a74-b5c13b425d3c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1370 microversion: 2.1 time: 0.242614 May 17 17:13:00.287487 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 193/421] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:00 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:00.821691 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-42affad1-cb65-4e69-b1c9-3d25b8c81636 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:00.822429 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-42affad1-cb65-4e69-b1c9-3d25b8c81636 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:00.829233 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-42affad1-cb65-4e69-b1c9-3d25b8c81636 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:00.829686 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-42affad1-cb65-4e69-b1c9-3d25b8c81636 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:00.830728 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-42affad1-cb65-4e69-b1c9-3d25b8c81636 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:00.831171 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-42affad1-cb65-4e69-b1c9-3d25b8c81636 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:00.973430 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-259b1027-d765-49cc-8829-434829b0ff8e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:00.975003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-259b1027-d765-49cc-8829-434829b0ff8e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:00.984859 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-42affad1-cb65-4e69-b1c9-3d25b8c81636 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:00.988478 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-259b1027-d765-49cc-8829-434829b0ff8e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:00.989212 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-259b1027-d765-49cc-8829-434829b0ff8e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:00.990279 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-259b1027-d765-49cc-8829-434829b0ff8e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:00.990870 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-259b1027-d765-49cc-8829-434829b0ff8e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:00.993585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-42affad1-cb65-4e69-b1c9-3d25b8c81636 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:00.995086 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-42affad1-cb65-4e69-b1c9-3d25b8c81636 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:00.996261 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-42affad1-cb65-4e69-b1c9-3d25b8c81636 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1740 microversion: 2.20 time: 0.179816 May 17 17:13:01.003193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 229/422] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:00 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:01.043862 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-259b1027-d765-49cc-8829-434829b0ff8e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:01.044336 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-259b1027-d765-49cc-8829-434829b0ff8e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:01.044801 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-259b1027-d765-49cc-8829-434829b0ff8e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lazy-loading 'fault' on Instance uuid 159a856c-1046-429c-91b8-71de1b5adc15 {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:13:01.077021 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b32b27d1-911b-4ed4-8641-9501099ab4e0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:01.078022 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b32b27d1-911b-4ed4-8641-9501099ab4e0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:01.088119 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b32b27d1-911b-4ed4-8641-9501099ab4e0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:01.088618 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b32b27d1-911b-4ed4-8641-9501099ab4e0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:01.089593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b32b27d1-911b-4ed4-8641-9501099ab4e0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:01.090195 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b32b27d1-911b-4ed4-8641-9501099ab4e0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:01.104022 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-259b1027-d765-49cc-8829-434829b0ff8e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:01.112928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-259b1027-d765-49cc-8829-434829b0ff8e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 200 len: 1309 microversion: 2.1 time: 0.144105 May 17 17:13:01.124557 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 194/423] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:00 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 1309 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:13:01.163867 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b32b27d1-911b-4ed4-8641-9501099ab4e0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:01.171997 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b32b27d1-911b-4ed4-8641-9501099ab4e0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1204 microversion: 2.1 time: 0.099167 May 17 17:13:01.173230 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 230/424] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:01 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1204 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:13:01.305018 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-fe171a02-0420-4052-801e-6cc3515bbe1e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:01.305644 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-fe171a02-0420-4052-801e-6cc3515bbe1e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:01.331911 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fe171a02-0420-4052-801e-6cc3515bbe1e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:01.332393 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fe171a02-0420-4052-801e-6cc3515bbe1e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:01.333275 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fe171a02-0420-4052-801e-6cc3515bbe1e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:01.333727 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fe171a02-0420-4052-801e-6cc3515bbe1e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:01.540002 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-fe171a02-0420-4052-801e-6cc3515bbe1e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:01.551125 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-fe171a02-0420-4052-801e-6cc3515bbe1e tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1564 microversion: 2.1 time: 0.250456 May 17 17:13:01.562450 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 195/425] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:01 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1564 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:01.571075 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-075156e2-79d1-4cfd-98e4-d73ef0824f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:01.571584 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-075156e2-79d1-4cfd-98e4-d73ef0824f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:01.578907 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-075156e2-79d1-4cfd-98e4-d73ef0824f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:01.579356 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-075156e2-79d1-4cfd-98e4-d73ef0824f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:01.580250 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-075156e2-79d1-4cfd-98e4-d73ef0824f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:01.583992 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-075156e2-79d1-4cfd-98e4-d73ef0824f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:01.684266 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-075156e2-79d1-4cfd-98e4-d73ef0824f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118185 May 17 17:13:01.704040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 231/426] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 17 17:13:01 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:02.014162 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7fef0516-e259-410f-bb09-29643a467727 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:02.014777 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7fef0516-e259-410f-bb09-29643a467727 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:02.030857 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7fef0516-e259-410f-bb09-29643a467727 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:02.031387 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7fef0516-e259-410f-bb09-29643a467727 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:02.032618 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7fef0516-e259-410f-bb09-29643a467727 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:02.033324 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7fef0516-e259-410f-bb09-29643a467727 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:02.151881 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ca8f227c-6adc-425d-840e-8fee9d03b5b7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:02.152503 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ca8f227c-6adc-425d-840e-8fee9d03b5b7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: 159a856c-1046-429c-91b8-71de1b5adc15] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:02.160924 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca8f227c-6adc-425d-840e-8fee9d03b5b7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:02.161397 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca8f227c-6adc-425d-840e-8fee9d03b5b7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:02.162221 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca8f227c-6adc-425d-840e-8fee9d03b5b7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:02.164080 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca8f227c-6adc-425d-840e-8fee9d03b5b7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:02.195341 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-ca8f227c-6adc-425d-840e-8fee9d03b5b7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] HTTP exception thrown: Instance 159a856c-1046-429c-91b8-71de1b5adc15 could not be found. May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ca8f227c-6adc-425d-840e-8fee9d03b5b7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Request method failure captured: May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 HTTP/1.1 May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9dODP0bMLXtc5_2gFDRQQlbMlB6GchrefIxCll4qkPZWdJe62W4_5KWP9kjBDlzrur3XEZHCLJn9sYQ9X8GPBjdIIELqr50sf8rR6qYOejxPr2WC64_J6LdBjl_zbfkVUwu1OJxc0kJG1KfXYmIT6mI96HjoBTQXPOdQAa7_DGmvV8 May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 260311245b60460283c01ebc87cb5bc2 May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1163535666 May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:13:02.197128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:13:02.198757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260311245b60460283c01ebc87cb5bc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_260311245b60460283c01ebc87cb5bc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/260311245b60460283c01ebc87cb5bc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260311245b60460283c01ebc87cb5bc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:13:02.198757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-VolumesSnapshotTestJSON-1163535666 May 17 17:13:02.198757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 260311245b60460283c01ebc87cb5bc2 May 17 17:13:02.198757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1163535666 May 17 17:13:02.198757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-VolumesSnapshotTestJSON-1163535666-project May 17 17:13:02.198757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:13:02.198757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:13:02.198757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: d7b9ce69a40845c5adef40e3e0355747 May 17 17:13:02.198757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-VolumesSnapshotTestJSON-1163535666-project May 17 17:13:02.198757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:13:02.198757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance 159a856c-1046-429c-91b8-71de1b5adc15 could not be found. May 17 17:13:02.198757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '159a856c-1046-429c-91b8-71de1b5adc15'} May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159a856c-1046-429c-91b8-71de1b5adc15 could not be found. May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:13:02.199737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159a856c-1046-429c-91b8-71de1b5adc15 could not be found. May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159a856c-1046-429c-91b8-71de1b5adc15 could not be found. May 17 17:13:02.201212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:13:02.202500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ca8f227c-6adc-425d-840e-8fee9d03b5b7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Returning 404 to user: Instance 159a856c-1046-429c-91b8-71de1b5adc15 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:13:02.202500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ca8f227c-6adc-425d-840e-8fee9d03b5b7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15" status: 404 len: 111 microversion: 2.1 time: 0.069304 May 17 17:13:02.202500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 232/427] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:02 2022] GET /compute/v2.1/servers/159a856c-1046-429c-91b8-71de1b5adc15 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:13:02.204793 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1eed15b9-816d-4f7f-b2dd-cc69427ca144 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:02.205406 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1eed15b9-816d-4f7f-b2dd-cc69427ca144 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:02.232395 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1eed15b9-816d-4f7f-b2dd-cc69427ca144 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:02.236702 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1eed15b9-816d-4f7f-b2dd-cc69427ca144 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:02.237778 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1eed15b9-816d-4f7f-b2dd-cc69427ca144 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:02.238515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1eed15b9-816d-4f7f-b2dd-cc69427ca144 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:02.632707 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1eed15b9-816d-4f7f-b2dd-cc69427ca144 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:02.645284 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1eed15b9-816d-4f7f-b2dd-cc69427ca144 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.444746 May 17 17:13:02.647018 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 233/428] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:02 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:02.710717 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7fef0516-e259-410f-bb09-29643a467727 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:02.718415 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7fef0516-e259-410f-bb09-29643a467727 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:02.720539 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7fef0516-e259-410f-bb09-29643a467727 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:02.721733 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7fef0516-e259-410f-bb09-29643a467727 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1740 microversion: 2.20 time: 0.711387 May 17 17:13:02.722297 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 196/429] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:02 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1740 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:03.194988 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-975d80e1-2952-4816-8680-b27c6c566b3e req-318fd76a-0d5f-45f0-aac8-0a67ef12e1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47d1426b-07f8-410e-b753-b1d8e9c1102f", "tag": "72213c8f-95d2-4e6b-bc71-ec5cf8e62273"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:03.210418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-975d80e1-2952-4816-8680-b27c6c566b3e req-318fd76a-0d5f-45f0-aac8-0a67ef12e1e4 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:03.210862 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-975d80e1-2952-4816-8680-b27c6c566b3e req-318fd76a-0d5f-45f0-aac8-0a67ef12e1e4 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:03.230307 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-975d80e1-2952-4816-8680-b27c6c566b3e req-318fd76a-0d5f-45f0-aac8-0a67ef12e1e4 service nova] Creating event network-changed:72213c8f-95d2-4e6b-bc71-ec5cf8e62273 for instance 47d1426b-07f8-410e-b753-b1d8e9c1102f on hv-cinder-84214 May 17 17:13:03.238183 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-975d80e1-2952-4816-8680-b27c6c566b3e req-318fd76a-0d5f-45f0-aac8-0a67ef12e1e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046938 May 17 17:13:03.238788 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 234/430] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:03.579103 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-fc02a479-4f89-492a-96c3-82637b752e2a req-d1c3cd5f-a001-4833-b091-c325b986e02c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfa0b8b-6981-43aa-9f5c-214bc3c20d64", "tag": "6b3cb952-d5bd-4de9-965c-39fcdbf9ab21"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:03.594020 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-fc02a479-4f89-492a-96c3-82637b752e2a req-d1c3cd5f-a001-4833-b091-c325b986e02c service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:03.608632 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-fc02a479-4f89-492a-96c3-82637b752e2a req-d1c3cd5f-a001-4833-b091-c325b986e02c service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:03.628020 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-fc02a479-4f89-492a-96c3-82637b752e2a req-d1c3cd5f-a001-4833-b091-c325b986e02c service nova] Creating event network-changed:6b3cb952-d5bd-4de9-965c-39fcdbf9ab21 for instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 on hv-cinder-84214 May 17 17:13:03.638466 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-fc02a479-4f89-492a-96c3-82637b752e2a req-d1c3cd5f-a001-4833-b091-c325b986e02c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067718 May 17 17:13:03.639673 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 197/431] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:03.666237 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ed39e1ff-141a-4cf4-b0bd-d4063757cd6b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:03.667247 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ed39e1ff-141a-4cf4-b0bd-d4063757cd6b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:03.675457 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ed39e1ff-141a-4cf4-b0bd-d4063757cd6b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:03.675967 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ed39e1ff-141a-4cf4-b0bd-d4063757cd6b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:03.676751 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ed39e1ff-141a-4cf4-b0bd-d4063757cd6b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:03.677184 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ed39e1ff-141a-4cf4-b0bd-d4063757cd6b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:03.743451 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-51982df7-e8c8-4470-85ae-b767096c9f5e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:03.744353 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-51982df7-e8c8-4470-85ae-b767096c9f5e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:03.759510 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-51982df7-e8c8-4470-85ae-b767096c9f5e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:03.763922 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-51982df7-e8c8-4470-85ae-b767096c9f5e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:03.765043 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-51982df7-e8c8-4470-85ae-b767096c9f5e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:03.767859 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-51982df7-e8c8-4470-85ae-b767096c9f5e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:03.901518 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ed39e1ff-141a-4cf4-b0bd-d4063757cd6b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:03.912319 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ed39e1ff-141a-4cf4-b0bd-d4063757cd6b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.252278 May 17 17:13:03.914228 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 235/432] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:03 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:03.994303 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-51982df7-e8c8-4470-85ae-b767096c9f5e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:04.004219 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-51982df7-e8c8-4470-85ae-b767096c9f5e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:04.006198 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-51982df7-e8c8-4470-85ae-b767096c9f5e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:04.009346 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-51982df7-e8c8-4470-85ae-b767096c9f5e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1740 microversion: 2.20 time: 0.271779 May 17 17:13:04.021237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 198/433] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:03 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1740 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:04.930651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d1fe0899-1934-4857-a86d-2370305cbc6d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:04.931414 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d1fe0899-1934-4857-a86d-2370305cbc6d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:04.940257 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d1fe0899-1934-4857-a86d-2370305cbc6d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:04.940884 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d1fe0899-1934-4857-a86d-2370305cbc6d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:04.941815 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d1fe0899-1934-4857-a86d-2370305cbc6d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:04.942468 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d1fe0899-1934-4857-a86d-2370305cbc6d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:05.028946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-105c40b6-c0a3-4a02-9c34-ab644c3a2330 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:05.030383 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-105c40b6-c0a3-4a02-9c34-ab644c3a2330 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:05.039983 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-105c40b6-c0a3-4a02-9c34-ab644c3a2330 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:05.040691 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-105c40b6-c0a3-4a02-9c34-ab644c3a2330 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:05.041707 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-105c40b6-c0a3-4a02-9c34-ab644c3a2330 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:05.042680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-105c40b6-c0a3-4a02-9c34-ab644c3a2330 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:05.133591 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d1fe0899-1934-4857-a86d-2370305cbc6d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:05.142493 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d1fe0899-1934-4857-a86d-2370305cbc6d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.215696 May 17 17:13:05.143292 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 236/434] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:04 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:05.230502 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-105c40b6-c0a3-4a02-9c34-ab644c3a2330 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:05.239572 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-105c40b6-c0a3-4a02-9c34-ab644c3a2330 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:05.241112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-105c40b6-c0a3-4a02-9c34-ab644c3a2330 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:05.242421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-105c40b6-c0a3-4a02-9c34-ab644c3a2330 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1740 microversion: 2.20 time: 0.217644 May 17 17:13:05.242987 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 199/435] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:05 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:06.160498 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c122e3e2-dd67-4b87-8564-37d2cd0c6639 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:06.161257 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c122e3e2-dd67-4b87-8564-37d2cd0c6639 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:06.167828 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c122e3e2-dd67-4b87-8564-37d2cd0c6639 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:06.168300 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c122e3e2-dd67-4b87-8564-37d2cd0c6639 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:06.169069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c122e3e2-dd67-4b87-8564-37d2cd0c6639 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:06.169510 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c122e3e2-dd67-4b87-8564-37d2cd0c6639 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:06.260576 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f1043b4d-6fa7-4234-a465-4c4a7b7d6e4b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:06.261276 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f1043b4d-6fa7-4234-a465-4c4a7b7d6e4b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:06.267877 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f1043b4d-6fa7-4234-a465-4c4a7b7d6e4b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:06.268353 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f1043b4d-6fa7-4234-a465-4c4a7b7d6e4b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:06.269140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f1043b4d-6fa7-4234-a465-4c4a7b7d6e4b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:06.269583 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f1043b4d-6fa7-4234-a465-4c4a7b7d6e4b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:06.306292 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c122e3e2-dd67-4b87-8564-37d2cd0c6639 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:06.313938 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c122e3e2-dd67-4b87-8564-37d2cd0c6639 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.158752 May 17 17:13:06.314519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 237/436] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:06 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:06.421811 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f1043b4d-6fa7-4234-a465-4c4a7b7d6e4b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:06.430426 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f1043b4d-6fa7-4234-a465-4c4a7b7d6e4b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:06.432046 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f1043b4d-6fa7-4234-a465-4c4a7b7d6e4b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:06.433318 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f1043b4d-6fa7-4234-a465-4c4a7b7d6e4b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1740 microversion: 2.20 time: 0.176502 May 17 17:13:06.433940 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 200/437] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:06 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:07.330238 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-233555ed-034e-48ba-a478-f8b61185e8b0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:07.330838 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-233555ed-034e-48ba-a478-f8b61185e8b0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:07.337524 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-233555ed-034e-48ba-a478-f8b61185e8b0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:07.337973 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-233555ed-034e-48ba-a478-f8b61185e8b0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:07.338732 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-233555ed-034e-48ba-a478-f8b61185e8b0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:07.339207 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-233555ed-034e-48ba-a478-f8b61185e8b0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:07.452122 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3bc3ad70-c490-4b63-b500-1538ac236e08 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:07.452739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3bc3ad70-c490-4b63-b500-1538ac236e08 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:07.459255 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3bc3ad70-c490-4b63-b500-1538ac236e08 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:07.459956 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3bc3ad70-c490-4b63-b500-1538ac236e08 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:07.460901 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3bc3ad70-c490-4b63-b500-1538ac236e08 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:07.461400 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3bc3ad70-c490-4b63-b500-1538ac236e08 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:07.473382 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-233555ed-034e-48ba-a478-f8b61185e8b0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:07.480765 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-233555ed-034e-48ba-a478-f8b61185e8b0 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.154408 May 17 17:13:07.481410 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 238/438] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:07 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:07.592492 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3bc3ad70-c490-4b63-b500-1538ac236e08 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:07.600965 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3bc3ad70-c490-4b63-b500-1538ac236e08 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:07.602467 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3bc3ad70-c490-4b63-b500-1538ac236e08 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:07.603622 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3bc3ad70-c490-4b63-b500-1538ac236e08 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1722 microversion: 2.20 time: 0.155284 May 17 17:13:07.604183 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 201/439] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:07 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:08.497861 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-40782808-6f43-42db-8358-a8ed2d830f5d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:08.498464 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-40782808-6f43-42db-8358-a8ed2d830f5d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:08.505160 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-40782808-6f43-42db-8358-a8ed2d830f5d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:08.505606 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-40782808-6f43-42db-8358-a8ed2d830f5d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:08.506360 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-40782808-6f43-42db-8358-a8ed2d830f5d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:08.506790 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-40782808-6f43-42db-8358-a8ed2d830f5d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:08.624844 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-17dd9d42-a462-4109-ad45-633f1397cd99 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:08.625227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-17dd9d42-a462-4109-ad45-633f1397cd99 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:08.631929 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-17dd9d42-a462-4109-ad45-633f1397cd99 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:08.633914 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-17dd9d42-a462-4109-ad45-633f1397cd99 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:08.634058 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-17dd9d42-a462-4109-ad45-633f1397cd99 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:08.634446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-17dd9d42-a462-4109-ad45-633f1397cd99 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:08.640701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-40782808-6f43-42db-8358-a8ed2d830f5d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:08.647896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-40782808-6f43-42db-8358-a8ed2d830f5d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.153783 May 17 17:13:08.648705 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 239/440] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:08 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:08.762424 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-17dd9d42-a462-4109-ad45-633f1397cd99 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:08.770650 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-17dd9d42-a462-4109-ad45-633f1397cd99 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:08.772173 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-17dd9d42-a462-4109-ad45-633f1397cd99 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:08.773337 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-17dd9d42-a462-4109-ad45-633f1397cd99 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1722 microversion: 2.20 time: 0.153014 May 17 17:13:08.773884 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 202/441] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:08 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:09.344896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-a966920a-e7c1-47c6-9ee0-ddf57f0a98f6 req-7a66dfb9-dc71-4ee0-8d34-9bdf8e73fbdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b074c961-149b-4667-addc-790568769b88", "name": "network-vif-unplugged", "status": "completed", "tag": "e6735ae1-4241-48ca-9802-22aba7b4cccc"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:09.353701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-a966920a-e7c1-47c6-9ee0-ddf57f0a98f6 req-7a66dfb9-dc71-4ee0-8d34-9bdf8e73fbdc service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:09.354178 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-a966920a-e7c1-47c6-9ee0-ddf57f0a98f6 req-7a66dfb9-dc71-4ee0-8d34-9bdf8e73fbdc service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:09.366482 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-a966920a-e7c1-47c6-9ee0-ddf57f0a98f6 req-7a66dfb9-dc71-4ee0-8d34-9bdf8e73fbdc service nova] Creating event network-vif-unplugged:e6735ae1-4241-48ca-9802-22aba7b4cccc for instance b074c961-149b-4667-addc-790568769b88 on hv-cinder-84214 May 17 17:13:09.371573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-a966920a-e7c1-47c6-9ee0-ddf57f0a98f6 req-7a66dfb9-dc71-4ee0-8d34-9bdf8e73fbdc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030857 May 17 17:13:09.372189 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 240/442] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:09.664210 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-bf6a83e9-05b5-4d82-8a87-5cf6ed5f4081 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:09.664752 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-bf6a83e9-05b5-4d82-8a87-5cf6ed5f4081 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:09.671045 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bf6a83e9-05b5-4d82-8a87-5cf6ed5f4081 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:09.671504 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bf6a83e9-05b5-4d82-8a87-5cf6ed5f4081 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:09.672301 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bf6a83e9-05b5-4d82-8a87-5cf6ed5f4081 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:09.672745 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bf6a83e9-05b5-4d82-8a87-5cf6ed5f4081 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:09.792537 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ff3937bc-27b8-4eca-9acc-561aec8df7cd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:09.793254 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ff3937bc-27b8-4eca-9acc-561aec8df7cd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:09.800633 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ff3937bc-27b8-4eca-9acc-561aec8df7cd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:09.801086 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ff3937bc-27b8-4eca-9acc-561aec8df7cd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:09.801862 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ff3937bc-27b8-4eca-9acc-561aec8df7cd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:09.802295 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ff3937bc-27b8-4eca-9acc-561aec8df7cd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:09.803727 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-bf6a83e9-05b5-4d82-8a87-5cf6ed5f4081 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:09.811103 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-bf6a83e9-05b5-4d82-8a87-5cf6ed5f4081 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.151094 May 17 17:13:09.811694 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 203/443] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:09 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:09.931681 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ff3937bc-27b8-4eca-9acc-561aec8df7cd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:09.939333 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ff3937bc-27b8-4eca-9acc-561aec8df7cd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:09.940850 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ff3937bc-27b8-4eca-9acc-561aec8df7cd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:09.941974 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ff3937bc-27b8-4eca-9acc-561aec8df7cd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1722 microversion: 2.20 time: 0.153711 May 17 17:13:09.942523 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 241/444] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:09 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:10.828416 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6474e9f2-e050-4a52-8b21-25213765f61a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:10.828931 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6474e9f2-e050-4a52-8b21-25213765f61a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:10.835999 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6474e9f2-e050-4a52-8b21-25213765f61a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:10.836472 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6474e9f2-e050-4a52-8b21-25213765f61a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:10.837256 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6474e9f2-e050-4a52-8b21-25213765f61a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:10.837689 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6474e9f2-e050-4a52-8b21-25213765f61a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:10.960460 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9cbefc57-48ea-4554-b318-70250983db31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:10.961089 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9cbefc57-48ea-4554-b318-70250983db31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:10.965954 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6474e9f2-e050-4a52-8b21-25213765f61a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:10.967412 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9cbefc57-48ea-4554-b318-70250983db31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:10.967896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9cbefc57-48ea-4554-b318-70250983db31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:10.968659 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9cbefc57-48ea-4554-b318-70250983db31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:10.969090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9cbefc57-48ea-4554-b318-70250983db31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:10.973720 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6474e9f2-e050-4a52-8b21-25213765f61a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.149203 May 17 17:13:10.974435 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 204/445] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:10 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:11.104496 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9cbefc57-48ea-4554-b318-70250983db31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:11.113199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9cbefc57-48ea-4554-b318-70250983db31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:11.114701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9cbefc57-48ea-4554-b318-70250983db31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:11.115877 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9cbefc57-48ea-4554-b318-70250983db31 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1722 microversion: 2.20 time: 0.159257 May 17 17:13:11.116434 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 242/446] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:10 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:11.990715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1a825564-c5ee-42b8-91ce-7e2237a32a3e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:11.991319 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1a825564-c5ee-42b8-91ce-7e2237a32a3e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:11.997612 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1a825564-c5ee-42b8-91ce-7e2237a32a3e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:11.998065 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1a825564-c5ee-42b8-91ce-7e2237a32a3e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:11.998862 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1a825564-c5ee-42b8-91ce-7e2237a32a3e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:11.999301 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1a825564-c5ee-42b8-91ce-7e2237a32a3e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:12.126379 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1a825564-c5ee-42b8-91ce-7e2237a32a3e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:12.133997 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5bbea731-2107-4f78-9ab7-0a1bf4e1a023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:12.134620 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1a825564-c5ee-42b8-91ce-7e2237a32a3e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.147670 May 17 17:13:12.134734 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5bbea731-2107-4f78-9ab7-0a1bf4e1a023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:12.135324 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 205/447] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:11 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:12.140800 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5bbea731-2107-4f78-9ab7-0a1bf4e1a023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:12.141251 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5bbea731-2107-4f78-9ab7-0a1bf4e1a023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:12.142232 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5bbea731-2107-4f78-9ab7-0a1bf4e1a023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:12.142901 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5bbea731-2107-4f78-9ab7-0a1bf4e1a023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:12.276877 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5bbea731-2107-4f78-9ab7-0a1bf4e1a023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:12.286171 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5bbea731-2107-4f78-9ab7-0a1bf4e1a023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:12.287768 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5bbea731-2107-4f78-9ab7-0a1bf4e1a023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:12.288995 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5bbea731-2107-4f78-9ab7-0a1bf4e1a023 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1665 microversion: 2.20 time: 0.158827 May 17 17:13:12.289355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-902830292", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "networks": [{"uuid": "6c7d9c40-84df-4392-abe5-e887770a65c6"}]}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:12.297498 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 243/448] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:12 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1665 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:12.306875 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e77ba970-e0b7-4693-b059-ce5fc649e083 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03736da3-e5c7-44f1-9aee-dc158ed7abe7"}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:12.308437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-e77ba970-e0b7-4693-b059-ce5fc649e083 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:12.314512 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e77ba970-e0b7-4693-b059-ce5fc649e083 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:12.314957 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e77ba970-e0b7-4693-b059-ce5fc649e083 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:12.315737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e77ba970-e0b7-4693-b059-ce5fc649e083 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:12.316170 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e77ba970-e0b7-4693-b059-ce5fc649e083 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:12.340404 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] validate_networks() for [('6c7d9c40-84df-4392-abe5-e887770a65c6', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:13:12.593941 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e77ba970-e0b7-4693-b059-ce5fc649e083 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "POST /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291004 May 17 17:13:12.594556 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 244/449] 10.222.0.48 () {62 vars in 1363 bytes} [Tue May 17 17:13:12 2022] POST /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/os-volume_attachments => generated 188 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:13:12.705602 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:13:12.706038 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:13:12.706520 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:13:12.706931 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:13:12.707344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:13:12.715413 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-99f19c7d-55a6-4412-89e2-f7cb3faa99ce tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:12.715997 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-99f19c7d-55a6-4412-89e2-f7cb3faa99ce tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:12.722513 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99f19c7d-55a6-4412-89e2-f7cb3faa99ce tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:12.722963 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99f19c7d-55a6-4412-89e2-f7cb3faa99ce tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:12.723415 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:12.723752 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99f19c7d-55a6-4412-89e2-f7cb3faa99ce tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:12.724030 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:12.724190 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99f19c7d-55a6-4412-89e2-f7cb3faa99ce tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:12.724896 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:12.725336 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:12.742518 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Getting quotas for project 260311245b60460283c01ebc87cb5bc2. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:13:12.746973 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Getting quotas for user d7b9ce69a40845c5adef40e3e0355747 and project 260311245b60460283c01ebc87cb5bc2. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:13:12.759996 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:13:12.762261 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:13:12.805844 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-479ce9e3-a9b7-4b82-80b1-b087888720e8 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520337 May 17 17:13:12.806487 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 206/450] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:13:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:13:12.816332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-99f19c7d-55a6-4412-89e2-f7cb3faa99ce tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "POST /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/action" status: 202 len: 0 microversion: 2.20 time: 0.104721 May 17 17:13:12.816884 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6627df50-78c1-4fcd-b709-7189934d56e1 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:12.817005 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 245/451] 10.222.0.48 () {62 vars in 1318 bytes} [Tue May 17 17:13:12 2022] POST /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 17 17:13:12.820583 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6627df50-78c1-4fcd-b709-7189934d56e1 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:12.825106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d90cdd43-2316-462e-bb3e-ba54d1fe32b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:12.825776 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d90cdd43-2316-462e-bb3e-ba54d1fe32b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:12.832722 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d90cdd43-2316-462e-bb3e-ba54d1fe32b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:12.833172 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d90cdd43-2316-462e-bb3e-ba54d1fe32b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:12.834480 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d90cdd43-2316-462e-bb3e-ba54d1fe32b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:12.834480 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d90cdd43-2316-462e-bb3e-ba54d1fe32b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:12.875906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6627df50-78c1-4fcd-b709-7189934d56e1 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:12.882713 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6627df50-78c1-4fcd-b709-7189934d56e1 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1218 microversion: 2.1 time: 0.070071 May 17 17:13:12.883385 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 207/452] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:12 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:13:12.993307 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d90cdd43-2316-462e-bb3e-ba54d1fe32b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:13.002171 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d90cdd43-2316-462e-bb3e-ba54d1fe32b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:13.003842 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d90cdd43-2316-462e-bb3e-ba54d1fe32b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:13.004996 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d90cdd43-2316-462e-bb3e-ba54d1fe32b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1751 microversion: 2.20 time: 0.183969 May 17 17:13:13.005557 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 246/453] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:12 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:13.151902 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-38bc1099-805a-4098-8a57-448eeedff9b3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:13.152538 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-38bc1099-805a-4098-8a57-448eeedff9b3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:13.159539 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-38bc1099-805a-4098-8a57-448eeedff9b3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:13.160487 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-38bc1099-805a-4098-8a57-448eeedff9b3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:13.161470 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-38bc1099-805a-4098-8a57-448eeedff9b3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:13.161914 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-38bc1099-805a-4098-8a57-448eeedff9b3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:13.301775 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-38bc1099-805a-4098-8a57-448eeedff9b3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:13.310768 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-38bc1099-805a-4098-8a57-448eeedff9b3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.162961 May 17 17:13:13.315752 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 208/454] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:13 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:13.898984 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5926040a-e2ac-40ac-895a-038d0b97c796 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:13.899507 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5926040a-e2ac-40ac-895a-038d0b97c796 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:13.905831 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5926040a-e2ac-40ac-895a-038d0b97c796 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:13.906281 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5926040a-e2ac-40ac-895a-038d0b97c796 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:13.907091 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5926040a-e2ac-40ac-895a-038d0b97c796 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:13.907580 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5926040a-e2ac-40ac-895a-038d0b97c796 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:13.968490 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5926040a-e2ac-40ac-895a-038d0b97c796 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:13.975843 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5926040a-e2ac-40ac-895a-038d0b97c796 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1270 microversion: 2.1 time: 0.080789 May 17 17:13:13.976402 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 247/455] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:13 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:14.023460 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-5240669c-e10f-487d-a0f1-cbca7f901524 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:14.024104 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-5240669c-e10f-487d-a0f1-cbca7f901524 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:14.029962 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5240669c-e10f-487d-a0f1-cbca7f901524 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:14.030414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5240669c-e10f-487d-a0f1-cbca7f901524 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:14.031167 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5240669c-e10f-487d-a0f1-cbca7f901524 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:14.031620 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5240669c-e10f-487d-a0f1-cbca7f901524 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:14.159440 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5240669c-e10f-487d-a0f1-cbca7f901524 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:14.169212 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5240669c-e10f-487d-a0f1-cbca7f901524 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:14.170710 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5240669c-e10f-487d-a0f1-cbca7f901524 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:14.171920 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-5240669c-e10f-487d-a0f1-cbca7f901524 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1751 microversion: 2.20 time: 0.152221 May 17 17:13:14.172489 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 209/456] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:14 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:14.328400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a9dfcee7-e192-4eb2-af4c-a45a625eb61b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:14.329012 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a9dfcee7-e192-4eb2-af4c-a45a625eb61b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:14.336023 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a9dfcee7-e192-4eb2-af4c-a45a625eb61b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:14.336583 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a9dfcee7-e192-4eb2-af4c-a45a625eb61b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:14.337533 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a9dfcee7-e192-4eb2-af4c-a45a625eb61b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:14.338350 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a9dfcee7-e192-4eb2-af4c-a45a625eb61b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:14.494590 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a9dfcee7-e192-4eb2-af4c-a45a625eb61b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:14.501994 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a9dfcee7-e192-4eb2-af4c-a45a625eb61b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.177526 May 17 17:13:14.502576 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 248/457] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:14 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:14.993829 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-bbbe53c9-e8e4-45f9-a478-c23e61e68d0f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:14.994553 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-bbbe53c9-e8e4-45f9-a478-c23e61e68d0f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:15.002529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bbbe53c9-e8e4-45f9-a478-c23e61e68d0f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:15.002982 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bbbe53c9-e8e4-45f9-a478-c23e61e68d0f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:15.003850 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bbbe53c9-e8e4-45f9-a478-c23e61e68d0f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:15.004507 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bbbe53c9-e8e4-45f9-a478-c23e61e68d0f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:15.152779 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-bbbe53c9-e8e4-45f9-a478-c23e61e68d0f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:15.161080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-bbbe53c9-e8e4-45f9-a478-c23e61e68d0f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.172074 May 17 17:13:15.161692 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 210/458] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:14 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:15.193245 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d214f9b7-9a54-4b02-8e7e-02adf777bc0b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:15.193996 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d214f9b7-9a54-4b02-8e7e-02adf777bc0b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:15.200443 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d214f9b7-9a54-4b02-8e7e-02adf777bc0b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:15.200893 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d214f9b7-9a54-4b02-8e7e-02adf777bc0b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:15.201655 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d214f9b7-9a54-4b02-8e7e-02adf777bc0b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:15.202092 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d214f9b7-9a54-4b02-8e7e-02adf777bc0b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:15.336184 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d214f9b7-9a54-4b02-8e7e-02adf777bc0b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:15.344690 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d214f9b7-9a54-4b02-8e7e-02adf777bc0b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:15.346310 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d214f9b7-9a54-4b02-8e7e-02adf777bc0b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:15.347456 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d214f9b7-9a54-4b02-8e7e-02adf777bc0b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.159086 May 17 17:13:15.348051 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 249/459] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:15 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:15.519257 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0535491b-e6f3-4c65-8c73-8c37bb7d1492 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:15.519917 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0535491b-e6f3-4c65-8c73-8c37bb7d1492 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:15.526290 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0535491b-e6f3-4c65-8c73-8c37bb7d1492 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:15.526758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0535491b-e6f3-4c65-8c73-8c37bb7d1492 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:15.527517 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0535491b-e6f3-4c65-8c73-8c37bb7d1492 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:15.527980 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0535491b-e6f3-4c65-8c73-8c37bb7d1492 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:15.663256 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0535491b-e6f3-4c65-8c73-8c37bb7d1492 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:15.671067 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0535491b-e6f3-4c65-8c73-8c37bb7d1492 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.155752 May 17 17:13:15.671725 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 211/460] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:15 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:16.178982 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3a603636-3b42-4d91-8d17-ec6df23091ea tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:16.179812 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-3a603636-3b42-4d91-8d17-ec6df23091ea tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:16.188412 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3a603636-3b42-4d91-8d17-ec6df23091ea tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:16.190034 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3a603636-3b42-4d91-8d17-ec6df23091ea tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:16.190416 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3a603636-3b42-4d91-8d17-ec6df23091ea tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:16.191779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3a603636-3b42-4d91-8d17-ec6df23091ea tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:16.348179 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-3a603636-3b42-4d91-8d17-ec6df23091ea tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:16.356063 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-3a603636-3b42-4d91-8d17-ec6df23091ea tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.182310 May 17 17:13:16.356636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 250/461] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:16 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:16.366171 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-af408877-860a-4270-b4f7-96bc5fa32738 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:16.366782 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-af408877-860a-4270-b4f7-96bc5fa32738 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:16.373516 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-af408877-860a-4270-b4f7-96bc5fa32738 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:16.373965 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-af408877-860a-4270-b4f7-96bc5fa32738 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:16.374733 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-af408877-860a-4270-b4f7-96bc5fa32738 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:16.375184 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-af408877-860a-4270-b4f7-96bc5fa32738 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:16.429877 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-aa6e3968-22e1-42b0-a32e-64ee4f23a3dd req-5b8b5a29-d0bc-48aa-b30a-0578f93754c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6612e19-6897-484d-85df-fbd505399146", "tag": "f2f7cadc-2d7c-4ce1-9fa9-fbab98a5ecdf"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:16.440270 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-aa6e3968-22e1-42b0-a32e-64ee4f23a3dd req-5b8b5a29-d0bc-48aa-b30a-0578f93754c9 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:16.440897 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-aa6e3968-22e1-42b0-a32e-64ee4f23a3dd req-5b8b5a29-d0bc-48aa-b30a-0578f93754c9 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:16.455685 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-aa6e3968-22e1-42b0-a32e-64ee4f23a3dd req-5b8b5a29-d0bc-48aa-b30a-0578f93754c9 service nova] Creating event network-changed:f2f7cadc-2d7c-4ce1-9fa9-fbab98a5ecdf for instance f6612e19-6897-484d-85df-fbd505399146 on hv-cinder-84214 May 17 17:13:16.461512 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-aa6e3968-22e1-42b0-a32e-64ee4f23a3dd req-5b8b5a29-d0bc-48aa-b30a-0578f93754c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035584 May 17 17:13:16.462115 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 251/462] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:16.523561 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-af408877-860a-4270-b4f7-96bc5fa32738 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:16.532983 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-af408877-860a-4270-b4f7-96bc5fa32738 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:16.534954 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-af408877-860a-4270-b4f7-96bc5fa32738 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:16.536137 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-af408877-860a-4270-b4f7-96bc5fa32738 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.174017 May 17 17:13:16.536692 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 212/463] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:16 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:16.689667 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7bb63181-2b1d-4bb7-8edb-c62fe3b80591 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:16.690541 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7bb63181-2b1d-4bb7-8edb-c62fe3b80591 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:16.697914 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7bb63181-2b1d-4bb7-8edb-c62fe3b80591 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:16.697914 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7bb63181-2b1d-4bb7-8edb-c62fe3b80591 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:16.698643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7bb63181-2b1d-4bb7-8edb-c62fe3b80591 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:16.699077 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7bb63181-2b1d-4bb7-8edb-c62fe3b80591 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:16.838043 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7bb63181-2b1d-4bb7-8edb-c62fe3b80591 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:16.848057 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7bb63181-2b1d-4bb7-8edb-c62fe3b80591 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.163096 May 17 17:13:16.857439 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 252/464] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:16 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:17.263765 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-cc8ca9ac-7b1a-4511-b2aa-50d063bfea8e req-d635729f-4bf4-4b49-a46e-0deb99abe6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d1426b-07f8-410e-b753-b1d8e9c1102f", "name": "network-vif-plugged", "status": "completed", "tag": "72213c8f-95d2-4e6b-bc71-ec5cf8e62273"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:17.273485 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-cc8ca9ac-7b1a-4511-b2aa-50d063bfea8e req-d635729f-4bf4-4b49-a46e-0deb99abe6d5 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:17.273955 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-cc8ca9ac-7b1a-4511-b2aa-50d063bfea8e req-d635729f-4bf4-4b49-a46e-0deb99abe6d5 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:17.288687 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-cc8ca9ac-7b1a-4511-b2aa-50d063bfea8e req-d635729f-4bf4-4b49-a46e-0deb99abe6d5 service nova] Creating event network-vif-plugged:72213c8f-95d2-4e6b-bc71-ec5cf8e62273 for instance 47d1426b-07f8-410e-b753-b1d8e9c1102f on hv-cinder-84214 May 17 17:13:17.293743 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-cc8ca9ac-7b1a-4511-b2aa-50d063bfea8e req-d635729f-4bf4-4b49-a46e-0deb99abe6d5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033767 May 17 17:13:17.294656 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 213/465] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:17.373319 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-fe81259a-db85-4ba0-a34c-8aa36a6e0a07 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:17.373931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-fe81259a-db85-4ba0-a34c-8aa36a6e0a07 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:17.380941 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fe81259a-db85-4ba0-a34c-8aa36a6e0a07 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:17.381386 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fe81259a-db85-4ba0-a34c-8aa36a6e0a07 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:17.382145 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fe81259a-db85-4ba0-a34c-8aa36a6e0a07 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:17.382580 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fe81259a-db85-4ba0-a34c-8aa36a6e0a07 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:17.512066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-fe81259a-db85-4ba0-a34c-8aa36a6e0a07 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:17.519942 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-fe81259a-db85-4ba0-a34c-8aa36a6e0a07 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.150438 May 17 17:13:17.520513 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 253/466] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:17 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:17.555144 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2d268663-db20-4987-b2fd-d2f654e05222 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:17.555857 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2d268663-db20-4987-b2fd-d2f654e05222 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:17.561878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2d268663-db20-4987-b2fd-d2f654e05222 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:17.562328 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2d268663-db20-4987-b2fd-d2f654e05222 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:17.563079 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2d268663-db20-4987-b2fd-d2f654e05222 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:17.564115 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2d268663-db20-4987-b2fd-d2f654e05222 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:17.689082 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2d268663-db20-4987-b2fd-d2f654e05222 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:17.697217 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2d268663-db20-4987-b2fd-d2f654e05222 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:17.698708 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2d268663-db20-4987-b2fd-d2f654e05222 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:17.699872 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2d268663-db20-4987-b2fd-d2f654e05222 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.149275 May 17 17:13:17.700427 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 214/467] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:17 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:17.865459 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-961d6221-87e2-4108-ad5e-ce9b2ceb182f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:17.866067 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-961d6221-87e2-4108-ad5e-ce9b2ceb182f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:17.872002 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-961d6221-87e2-4108-ad5e-ce9b2ceb182f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:17.872458 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-961d6221-87e2-4108-ad5e-ce9b2ceb182f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:17.873219 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-961d6221-87e2-4108-ad5e-ce9b2ceb182f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:17.873652 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-961d6221-87e2-4108-ad5e-ce9b2ceb182f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:18.012112 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-961d6221-87e2-4108-ad5e-ce9b2ceb182f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:18.019749 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-961d6221-87e2-4108-ad5e-ce9b2ceb182f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.158301 May 17 17:13:18.020332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 254/468] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:17 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:13:18.537555 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-646de453-43ab-48f7-a0ab-9d6a54a8b317 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:18.538535 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-646de453-43ab-48f7-a0ab-9d6a54a8b317 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:18.544887 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-646de453-43ab-48f7-a0ab-9d6a54a8b317 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:18.545425 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-646de453-43ab-48f7-a0ab-9d6a54a8b317 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:18.546479 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-646de453-43ab-48f7-a0ab-9d6a54a8b317 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:18.547122 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-646de453-43ab-48f7-a0ab-9d6a54a8b317 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:18.693228 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-646de453-43ab-48f7-a0ab-9d6a54a8b317 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:18.702558 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-646de453-43ab-48f7-a0ab-9d6a54a8b317 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.168909 May 17 17:13:18.703298 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 215/469] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:18 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:13:18.718848 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9411bb3c-d35e-4fac-abdd-c2f2a347cbe3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:18.721022 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9411bb3c-d35e-4fac-abdd-c2f2a347cbe3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:18.728724 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9411bb3c-d35e-4fac-abdd-c2f2a347cbe3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:18.729317 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9411bb3c-d35e-4fac-abdd-c2f2a347cbe3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:18.730292 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9411bb3c-d35e-4fac-abdd-c2f2a347cbe3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:18.731267 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9411bb3c-d35e-4fac-abdd-c2f2a347cbe3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:18.873395 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9411bb3c-d35e-4fac-abdd-c2f2a347cbe3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:18.882825 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9411bb3c-d35e-4fac-abdd-c2f2a347cbe3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:18.884345 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9411bb3c-d35e-4fac-abdd-c2f2a347cbe3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:18.885489 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9411bb3c-d35e-4fac-abdd-c2f2a347cbe3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.171133 May 17 17:13:18.886041 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 255/470] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:18 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:19.036843 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d32849ea-ee83-4d88-bf02-603411ee1212 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:19.037538 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d32849ea-ee83-4d88-bf02-603411ee1212 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:19.055409 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d32849ea-ee83-4d88-bf02-603411ee1212 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:19.056024 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d32849ea-ee83-4d88-bf02-603411ee1212 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:19.056932 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d32849ea-ee83-4d88-bf02-603411ee1212 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:19.057435 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d32849ea-ee83-4d88-bf02-603411ee1212 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:19.193618 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d32849ea-ee83-4d88-bf02-603411ee1212 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:19.201026 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d32849ea-ee83-4d88-bf02-603411ee1212 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.168379 May 17 17:13:19.201847 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 216/471] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:19 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:19.720373 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-11df54db-7b12-4fc0-b6ba-5e58ab8d0861 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:19.720996 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-11df54db-7b12-4fc0-b6ba-5e58ab8d0861 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:19.734510 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-11df54db-7b12-4fc0-b6ba-5e58ab8d0861 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:19.734961 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-11df54db-7b12-4fc0-b6ba-5e58ab8d0861 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:19.736338 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-11df54db-7b12-4fc0-b6ba-5e58ab8d0861 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:19.736785 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-11df54db-7b12-4fc0-b6ba-5e58ab8d0861 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:19.884402 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-11df54db-7b12-4fc0-b6ba-5e58ab8d0861 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:19.892375 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-11df54db-7b12-4fc0-b6ba-5e58ab8d0861 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.175746 May 17 17:13:19.901558 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 256/472] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:19 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:19.910133 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-024e9e32-ca52-4a33-aa33-88cb7f67406b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:19.910728 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-024e9e32-ca52-4a33-aa33-88cb7f67406b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:19.929182 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-024e9e32-ca52-4a33-aa33-88cb7f67406b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:19.930211 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-024e9e32-ca52-4a33-aa33-88cb7f67406b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:19.931441 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-024e9e32-ca52-4a33-aa33-88cb7f67406b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:19.932056 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-024e9e32-ca52-4a33-aa33-88cb7f67406b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:20.071031 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-024e9e32-ca52-4a33-aa33-88cb7f67406b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:20.079533 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-024e9e32-ca52-4a33-aa33-88cb7f67406b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:20.081226 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-024e9e32-ca52-4a33-aa33-88cb7f67406b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:20.082483 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-024e9e32-ca52-4a33-aa33-88cb7f67406b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.177603 May 17 17:13:20.083038 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 217/473] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:19 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:20.219063 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ff45f80a-6f05-4be5-81fb-9ba3e687784e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:20.220369 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ff45f80a-6f05-4be5-81fb-9ba3e687784e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:20.227414 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ff45f80a-6f05-4be5-81fb-9ba3e687784e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:20.227893 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ff45f80a-6f05-4be5-81fb-9ba3e687784e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:20.228659 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ff45f80a-6f05-4be5-81fb-9ba3e687784e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:20.229085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ff45f80a-6f05-4be5-81fb-9ba3e687784e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:20.388103 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ff45f80a-6f05-4be5-81fb-9ba3e687784e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:20.398885 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ff45f80a-6f05-4be5-81fb-9ba3e687784e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.183749 May 17 17:13:20.404279 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 257/474] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:20 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:20.909736 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-80521fca-2739-42ad-9fc7-5c07f73df887 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:20.910496 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-80521fca-2739-42ad-9fc7-5c07f73df887 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:20.917347 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80521fca-2739-42ad-9fc7-5c07f73df887 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:20.917921 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80521fca-2739-42ad-9fc7-5c07f73df887 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:20.918808 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80521fca-2739-42ad-9fc7-5c07f73df887 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:20.919460 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80521fca-2739-42ad-9fc7-5c07f73df887 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:21.054293 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-80521fca-2739-42ad-9fc7-5c07f73df887 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:21.062416 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-80521fca-2739-42ad-9fc7-5c07f73df887 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.156967 May 17 17:13:21.062998 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 218/475] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:20 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:21.102016 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1c7eac13-a77f-477b-85a7-15c44ad4e690 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:21.102725 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1c7eac13-a77f-477b-85a7-15c44ad4e690 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:21.109160 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1c7eac13-a77f-477b-85a7-15c44ad4e690 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:21.109606 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1c7eac13-a77f-477b-85a7-15c44ad4e690 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:21.110616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1c7eac13-a77f-477b-85a7-15c44ad4e690 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:21.111058 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1c7eac13-a77f-477b-85a7-15c44ad4e690 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:21.241931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1c7eac13-a77f-477b-85a7-15c44ad4e690 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:21.252209 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1c7eac13-a77f-477b-85a7-15c44ad4e690 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:21.254308 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1c7eac13-a77f-477b-85a7-15c44ad4e690 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:21.255061 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1c7eac13-a77f-477b-85a7-15c44ad4e690 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.156837 May 17 17:13:21.255519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 258/476] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:21 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:21.425579 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3147f44e-1fb3-4df4-8d44-157f24887e89 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:21.426143 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3147f44e-1fb3-4df4-8d44-157f24887e89 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:21.432728 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3147f44e-1fb3-4df4-8d44-157f24887e89 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:21.433191 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3147f44e-1fb3-4df4-8d44-157f24887e89 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:21.434011 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3147f44e-1fb3-4df4-8d44-157f24887e89 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:21.434459 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3147f44e-1fb3-4df4-8d44-157f24887e89 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:21.573331 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3147f44e-1fb3-4df4-8d44-157f24887e89 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:21.581368 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3147f44e-1fb3-4df4-8d44-157f24887e89 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.159878 May 17 17:13:21.582239 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 219/477] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:21 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:22.080550 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-993ec913-7ec3-4a4c-bfd1-86d411147571 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:22.081159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-993ec913-7ec3-4a4c-bfd1-86d411147571 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:22.087091 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-993ec913-7ec3-4a4c-bfd1-86d411147571 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:22.087586 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-993ec913-7ec3-4a4c-bfd1-86d411147571 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:22.088434 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-993ec913-7ec3-4a4c-bfd1-86d411147571 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:22.088871 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-993ec913-7ec3-4a4c-bfd1-86d411147571 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:22.275205 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8580325e-ddc3-460b-a7b3-b27fea18932a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:22.275949 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8580325e-ddc3-460b-a7b3-b27fea18932a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:22.283176 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8580325e-ddc3-460b-a7b3-b27fea18932a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:22.284055 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8580325e-ddc3-460b-a7b3-b27fea18932a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:22.285462 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8580325e-ddc3-460b-a7b3-b27fea18932a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:22.286208 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8580325e-ddc3-460b-a7b3-b27fea18932a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:22.597781 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-993ec913-7ec3-4a4c-bfd1-86d411147571 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:22.609853 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-993ec913-7ec3-4a4c-bfd1-86d411147571 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.533071 May 17 17:13:22.621293 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 259/478] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:22 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:22.626878 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c275361a-577a-4883-8640-3ab636e9b03a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:22.627065 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-8580325e-ddc3-460b-a7b3-b27fea18932a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:22.627645 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c275361a-577a-4883-8640-3ab636e9b03a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:22.634711 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c275361a-577a-4883-8640-3ab636e9b03a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:22.635839 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c275361a-577a-4883-8640-3ab636e9b03a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:22.636866 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c275361a-577a-4883-8640-3ab636e9b03a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:22.637304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c275361a-577a-4883-8640-3ab636e9b03a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:22.637790 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-8580325e-ddc3-460b-a7b3-b27fea18932a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:22.639390 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-8580325e-ddc3-460b-a7b3-b27fea18932a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:22.640683 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8580325e-ddc3-460b-a7b3-b27fea18932a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.369774 May 17 17:13:22.641349 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 220/479] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:22 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:22.778491 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c275361a-577a-4883-8640-3ab636e9b03a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:22.786553 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c275361a-577a-4883-8640-3ab636e9b03a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.163853 May 17 17:13:22.787109 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 260/480] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:22 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:23.629556 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2e93dcd8-5861-40c0-8cb9-0ae2fd0ac6b2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:23.630466 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2e93dcd8-5861-40c0-8cb9-0ae2fd0ac6b2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:23.637310 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2e93dcd8-5861-40c0-8cb9-0ae2fd0ac6b2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:23.637847 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2e93dcd8-5861-40c0-8cb9-0ae2fd0ac6b2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:23.638690 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2e93dcd8-5861-40c0-8cb9-0ae2fd0ac6b2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:23.639128 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2e93dcd8-5861-40c0-8cb9-0ae2fd0ac6b2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:23.656798 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-e291c828-3b47-4413-b1e2-65568f98a47d req-f74c1360-144f-430b-8aea-6fd8575e803f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6612e19-6897-484d-85df-fbd505399146", "name": "network-vif-plugged", "status": "completed", "tag": "f2f7cadc-2d7c-4ce1-9fa9-fbab98a5ecdf"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:23.666924 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-e291c828-3b47-4413-b1e2-65568f98a47d req-f74c1360-144f-430b-8aea-6fd8575e803f service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:23.667369 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-e291c828-3b47-4413-b1e2-65568f98a47d req-f74c1360-144f-430b-8aea-6fd8575e803f service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:23.691340 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-e291c828-3b47-4413-b1e2-65568f98a47d req-f74c1360-144f-430b-8aea-6fd8575e803f service nova] Creating event network-vif-plugged:f2f7cadc-2d7c-4ce1-9fa9-fbab98a5ecdf for instance f6612e19-6897-484d-85df-fbd505399146 on hv-cinder-84214 May 17 17:13:23.698128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-e291c828-3b47-4413-b1e2-65568f98a47d req-f74c1360-144f-430b-8aea-6fd8575e803f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045480 May 17 17:13:23.698967 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 261/481] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:23.704857 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-126ad351-8d0c-4082-b8fa-050a46fe8ddc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:23.705968 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-126ad351-8d0c-4082-b8fa-050a46fe8ddc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:23.713433 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-126ad351-8d0c-4082-b8fa-050a46fe8ddc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:23.714102 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-126ad351-8d0c-4082-b8fa-050a46fe8ddc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:23.715073 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-126ad351-8d0c-4082-b8fa-050a46fe8ddc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:23.715848 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-126ad351-8d0c-4082-b8fa-050a46fe8ddc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:23.825524 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2e93dcd8-5861-40c0-8cb9-0ae2fd0ac6b2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:23.835185 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2e93dcd8-5861-40c0-8cb9-0ae2fd0ac6b2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.209726 May 17 17:13:23.836150 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 221/482] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:23 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:23.841744 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-35a8b339-88a4-45e7-abca-35621696e9a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:23.842823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-35a8b339-88a4-45e7-abca-35621696e9a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:23.850147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-35a8b339-88a4-45e7-abca-35621696e9a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:23.850927 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-35a8b339-88a4-45e7-abca-35621696e9a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:23.852790 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-35a8b339-88a4-45e7-abca-35621696e9a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:23.853494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-35a8b339-88a4-45e7-abca-35621696e9a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:23.898564 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-126ad351-8d0c-4082-b8fa-050a46fe8ddc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:23.907300 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-126ad351-8d0c-4082-b8fa-050a46fe8ddc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:23.908834 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-126ad351-8d0c-4082-b8fa-050a46fe8ddc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:23.910269 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-126ad351-8d0c-4082-b8fa-050a46fe8ddc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.209963 May 17 17:13:23.910864 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 262/483] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:23 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:24.008613 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-35a8b339-88a4-45e7-abca-35621696e9a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:24.015973 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-35a8b339-88a4-45e7-abca-35621696e9a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.178481 May 17 17:13:24.016673 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 222/484] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:23 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:24.865815 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-29425f9c-940e-4405-b6e9-ccb9c10955d7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:24.867097 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-29425f9c-940e-4405-b6e9-ccb9c10955d7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:24.874426 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-29425f9c-940e-4405-b6e9-ccb9c10955d7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:24.875157 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-29425f9c-940e-4405-b6e9-ccb9c10955d7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:24.876735 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-29425f9c-940e-4405-b6e9-ccb9c10955d7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:24.877435 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-29425f9c-940e-4405-b6e9-ccb9c10955d7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:24.929465 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e5fa388c-59fe-4109-924b-f10d43c4bb98 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:24.930103 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e5fa388c-59fe-4109-924b-f10d43c4bb98 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:24.936495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e5fa388c-59fe-4109-924b-f10d43c4bb98 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:24.937038 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e5fa388c-59fe-4109-924b-f10d43c4bb98 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:24.937817 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e5fa388c-59fe-4109-924b-f10d43c4bb98 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:24.938812 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e5fa388c-59fe-4109-924b-f10d43c4bb98 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:25.071093 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-29425f9c-940e-4405-b6e9-ccb9c10955d7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:25.078735 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-29425f9c-940e-4405-b6e9-ccb9c10955d7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.230565 May 17 17:13:25.080047 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 263/485] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:24 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:25.085900 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-47f64e10-1d84-400e-a1cc-fdd45a30ac0c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:25.086571 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-47f64e10-1d84-400e-a1cc-fdd45a30ac0c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:25.097277 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-47f64e10-1d84-400e-a1cc-fdd45a30ac0c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:25.097277 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-47f64e10-1d84-400e-a1cc-fdd45a30ac0c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:25.097277 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-47f64e10-1d84-400e-a1cc-fdd45a30ac0c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:25.097277 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-47f64e10-1d84-400e-a1cc-fdd45a30ac0c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:25.101936 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e5fa388c-59fe-4109-924b-f10d43c4bb98 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:25.112698 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e5fa388c-59fe-4109-924b-f10d43c4bb98 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:25.114543 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e5fa388c-59fe-4109-924b-f10d43c4bb98 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:25.115992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e5fa388c-59fe-4109-924b-f10d43c4bb98 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.190463 May 17 17:13:25.117054 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 223/486] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:24 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:25.262859 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-47f64e10-1d84-400e-a1cc-fdd45a30ac0c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:25.270751 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-47f64e10-1d84-400e-a1cc-fdd45a30ac0c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.189611 May 17 17:13:25.271548 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 264/487] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:25 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:26.098717 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4f4485be-4ab8-42bc-b56d-37982ad186d2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:26.099426 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4f4485be-4ab8-42bc-b56d-37982ad186d2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:26.105845 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4f4485be-4ab8-42bc-b56d-37982ad186d2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:26.106293 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4f4485be-4ab8-42bc-b56d-37982ad186d2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:26.107061 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4f4485be-4ab8-42bc-b56d-37982ad186d2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:26.107503 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4f4485be-4ab8-42bc-b56d-37982ad186d2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:26.136201 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7c8555ca-517a-44b5-9b65-5955642b75d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:26.136993 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7c8555ca-517a-44b5-9b65-5955642b75d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:26.144030 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7c8555ca-517a-44b5-9b65-5955642b75d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:26.144483 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7c8555ca-517a-44b5-9b65-5955642b75d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:26.145252 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7c8555ca-517a-44b5-9b65-5955642b75d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:26.145689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7c8555ca-517a-44b5-9b65-5955642b75d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:26.283542 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4f4485be-4ab8-42bc-b56d-37982ad186d2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:26.292338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4f4485be-4ab8-42bc-b56d-37982ad186d2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.198119 May 17 17:13:26.308714 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 224/488] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:26 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:26.318594 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0116f80e-4dd6-4aca-b919-5cca29bb5f32 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:26.319489 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0116f80e-4dd6-4aca-b919-5cca29bb5f32 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:26.336791 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0116f80e-4dd6-4aca-b919-5cca29bb5f32 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:26.337250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0116f80e-4dd6-4aca-b919-5cca29bb5f32 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:26.338095 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0116f80e-4dd6-4aca-b919-5cca29bb5f32 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:26.338575 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0116f80e-4dd6-4aca-b919-5cca29bb5f32 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:26.343654 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7c8555ca-517a-44b5-9b65-5955642b75d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:26.352408 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7c8555ca-517a-44b5-9b65-5955642b75d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:26.353867 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7c8555ca-517a-44b5-9b65-5955642b75d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:26.355025 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7c8555ca-517a-44b5-9b65-5955642b75d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.224606 May 17 17:13:26.355680 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 265/489] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:26 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:26.498966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0116f80e-4dd6-4aca-b919-5cca29bb5f32 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:26.509576 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0116f80e-4dd6-4aca-b919-5cca29bb5f32 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.199302 May 17 17:13:26.510521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 225/490] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:26 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:26.673571 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5856288b-fd2c-4c30-baf3-7547bd3b208b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:26.674269 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5856288b-fd2c-4c30-baf3-7547bd3b208b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:26.680951 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5856288b-fd2c-4c30-baf3-7547bd3b208b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:26.681447 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5856288b-fd2c-4c30-baf3-7547bd3b208b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:26.682490 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5856288b-fd2c-4c30-baf3-7547bd3b208b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:26.683452 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5856288b-fd2c-4c30-baf3-7547bd3b208b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:26.708927 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5856288b-fd2c-4c30-baf3-7547bd3b208b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5/ips" status: 200 len: 149 microversion: 2.1 time: 0.040707 May 17 17:13:26.711644 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 266/491] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 17 17:13:26 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:27.309548 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1633564d-6833-413a-8556-a2f0c800ed92 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:27.310237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1633564d-6833-413a-8556-a2f0c800ed92 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:27.317691 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1633564d-6833-413a-8556-a2f0c800ed92 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:27.318135 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1633564d-6833-413a-8556-a2f0c800ed92 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:27.319030 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1633564d-6833-413a-8556-a2f0c800ed92 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:27.319585 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1633564d-6833-413a-8556-a2f0c800ed92 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:27.375103 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-667741c7-8fb3-4533-b55a-ae64292bbaf7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:27.377291 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-667741c7-8fb3-4533-b55a-ae64292bbaf7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:27.384485 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-667741c7-8fb3-4533-b55a-ae64292bbaf7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:27.385250 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-667741c7-8fb3-4533-b55a-ae64292bbaf7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:27.386255 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-667741c7-8fb3-4533-b55a-ae64292bbaf7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:27.386893 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-667741c7-8fb3-4533-b55a-ae64292bbaf7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:27.538692 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1633564d-6833-413a-8556-a2f0c800ed92 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:27.549179 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1633564d-6833-413a-8556-a2f0c800ed92 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.242108 May 17 17:13:27.549967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 226/492] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:27 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:27.555343 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-90b82427-1822-4020-8c33-58edba3aff01 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:27.555996 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-90b82427-1822-4020-8c33-58edba3aff01 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:27.565699 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-90b82427-1822-4020-8c33-58edba3aff01 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:27.566520 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-90b82427-1822-4020-8c33-58edba3aff01 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:27.567313 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-90b82427-1822-4020-8c33-58edba3aff01 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:27.567785 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-90b82427-1822-4020-8c33-58edba3aff01 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:27.576092 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-667741c7-8fb3-4533-b55a-ae64292bbaf7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:27.586278 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-667741c7-8fb3-4533-b55a-ae64292bbaf7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:27.587798 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-667741c7-8fb3-4533-b55a-ae64292bbaf7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:27.588964 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-667741c7-8fb3-4533-b55a-ae64292bbaf7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.218349 May 17 17:13:27.589670 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 267/493] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:27 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:27.725401 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-90b82427-1822-4020-8c33-58edba3aff01 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:27.733223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-90b82427-1822-4020-8c33-58edba3aff01 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.182092 May 17 17:13:27.733797 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 227/494] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:27 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:28.095278 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-734a8f5a-0c7c-4775-bfec-24c1b0fd3375 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "548d5cdb-63b3-48e0-9170-ea0334b16444"}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:28.096433 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-734a8f5a-0c7c-4775-bfec-24c1b0fd3375 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:28.102303 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-734a8f5a-0c7c-4775-bfec-24c1b0fd3375 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:28.102745 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-734a8f5a-0c7c-4775-bfec-24c1b0fd3375 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:28.103495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-734a8f5a-0c7c-4775-bfec-24c1b0fd3375 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:28.103952 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-734a8f5a-0c7c-4775-bfec-24c1b0fd3375 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:28.566824 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-bcd577c3-00b1-436b-a9c4-ee9c66efd236 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:28.567441 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-bcd577c3-00b1-436b-a9c4-ee9c66efd236 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:28.574074 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bcd577c3-00b1-436b-a9c4-ee9c66efd236 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:28.574542 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bcd577c3-00b1-436b-a9c4-ee9c66efd236 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:28.575302 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bcd577c3-00b1-436b-a9c4-ee9c66efd236 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:28.575804 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bcd577c3-00b1-436b-a9c4-ee9c66efd236 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:28.707018 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-bcd577c3-00b1-436b-a9c4-ee9c66efd236 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:28.715248 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-bcd577c3-00b1-436b-a9c4-ee9c66efd236 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.153022 May 17 17:13:28.726374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 228/495] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:28 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:13:28.726374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-bb8cc30c-ba11-44fd-a99a-d462c0e17992 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:28.726374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-bb8cc30c-ba11-44fd-a99a-d462c0e17992 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:28.728196 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bb8cc30c-ba11-44fd-a99a-d462c0e17992 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:28.728651 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bb8cc30c-ba11-44fd-a99a-d462c0e17992 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:28.729434 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bb8cc30c-ba11-44fd-a99a-d462c0e17992 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:28.729873 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bb8cc30c-ba11-44fd-a99a-d462c0e17992 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:28.873257 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-bb8cc30c-ba11-44fd-a99a-d462c0e17992 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:28.883211 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-bb8cc30c-ba11-44fd-a99a-d462c0e17992 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:28.885259 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-bb8cc30c-ba11-44fd-a99a-d462c0e17992 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:28.886418 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-bb8cc30c-ba11-44fd-a99a-d462c0e17992 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.169651 May 17 17:13:28.887170 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 229/496] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:28 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:28.901605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-5ae72d68-d43f-48b6-a734-d496ba3a611d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:28.902218 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-5ae72d68-d43f-48b6-a734-d496ba3a611d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:28.909503 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5ae72d68-d43f-48b6-a734-d496ba3a611d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:28.909955 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5ae72d68-d43f-48b6-a734-d496ba3a611d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:28.910720 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5ae72d68-d43f-48b6-a734-d496ba3a611d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:28.911152 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5ae72d68-d43f-48b6-a734-d496ba3a611d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:29.042191 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5ae72d68-d43f-48b6-a734-d496ba3a611d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:29.050416 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-5ae72d68-d43f-48b6-a734-d496ba3a611d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.152490 May 17 17:13:29.050987 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 230/497] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:28 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:29.733263 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7959f689-e04b-41a4-87fa-3b55290b8b13 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:29.733911 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7959f689-e04b-41a4-87fa-3b55290b8b13 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:29.740496 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7959f689-e04b-41a4-87fa-3b55290b8b13 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:29.740944 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7959f689-e04b-41a4-87fa-3b55290b8b13 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:29.741698 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7959f689-e04b-41a4-87fa-3b55290b8b13 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:29.742136 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7959f689-e04b-41a4-87fa-3b55290b8b13 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:29.871270 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7959f689-e04b-41a4-87fa-3b55290b8b13 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:29.878746 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7959f689-e04b-41a4-87fa-3b55290b8b13 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.149442 May 17 17:13:29.879306 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 231/498] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:29 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:13:29.904192 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-41227542-8deb-4f9e-8667-33068a46fe12 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:29.904803 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-41227542-8deb-4f9e-8667-33068a46fe12 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:29.912091 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-41227542-8deb-4f9e-8667-33068a46fe12 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:29.912557 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-41227542-8deb-4f9e-8667-33068a46fe12 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:29.913326 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-41227542-8deb-4f9e-8667-33068a46fe12 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:29.913771 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-41227542-8deb-4f9e-8667-33068a46fe12 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:30.040133 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-41227542-8deb-4f9e-8667-33068a46fe12 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:30.048844 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-41227542-8deb-4f9e-8667-33068a46fe12 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:30.050363 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-41227542-8deb-4f9e-8667-33068a46fe12 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:30.051516 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-41227542-8deb-4f9e-8667-33068a46fe12 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.151048 May 17 17:13:30.052113 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 232/499] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:29 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:30.066390 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-837e4f6b-9cb9-4eef-bada-6514c77dfff3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:30.066996 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-837e4f6b-9cb9-4eef-bada-6514c77dfff3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:30.072727 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-837e4f6b-9cb9-4eef-bada-6514c77dfff3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:30.073156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-837e4f6b-9cb9-4eef-bada-6514c77dfff3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:30.073914 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-837e4f6b-9cb9-4eef-bada-6514c77dfff3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:30.074350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-837e4f6b-9cb9-4eef-bada-6514c77dfff3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:30.205440 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-837e4f6b-9cb9-4eef-bada-6514c77dfff3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:30.212866 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-837e4f6b-9cb9-4eef-bada-6514c77dfff3 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.150658 May 17 17:13:30.213433 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 233/500] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:30 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:13:30.852422 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-734a8f5a-0c7c-4775-bfec-24c1b0fd3375 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "POST /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.761019 May 17 17:13:30.853199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 268/501] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 17 17:13:28 2022] POST /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5/os-volume_attachments => generated 194 bytes in 2763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:30.895559 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-963ffdf1-3d3a-491e-89f8-416097f2f893 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:30.896219 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-963ffdf1-3d3a-491e-89f8-416097f2f893 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:30.904684 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-963ffdf1-3d3a-491e-89f8-416097f2f893 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:30.905218 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-963ffdf1-3d3a-491e-89f8-416097f2f893 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:30.906047 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-963ffdf1-3d3a-491e-89f8-416097f2f893 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:30.906487 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-963ffdf1-3d3a-491e-89f8-416097f2f893 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:31.035096 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-963ffdf1-3d3a-491e-89f8-416097f2f893 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:31.042651 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-963ffdf1-3d3a-491e-89f8-416097f2f893 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.150859 May 17 17:13:31.043216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 234/502] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:30 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:31.070520 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a39fea57-096f-49f2-b0a7-57f07ffbc002 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:31.071234 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a39fea57-096f-49f2-b0a7-57f07ffbc002 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:31.077462 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a39fea57-096f-49f2-b0a7-57f07ffbc002 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:31.077905 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a39fea57-096f-49f2-b0a7-57f07ffbc002 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:31.078708 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a39fea57-096f-49f2-b0a7-57f07ffbc002 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:31.079235 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a39fea57-096f-49f2-b0a7-57f07ffbc002 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:31.205913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a39fea57-096f-49f2-b0a7-57f07ffbc002 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:31.214191 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a39fea57-096f-49f2-b0a7-57f07ffbc002 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:31.215713 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a39fea57-096f-49f2-b0a7-57f07ffbc002 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:31.216857 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a39fea57-096f-49f2-b0a7-57f07ffbc002 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.151061 May 17 17:13:31.217411 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 269/503] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:31 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:31.229470 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1467b309-ebe5-48a1-9012-2ed5c3863a98 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:31.230072 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1467b309-ebe5-48a1-9012-2ed5c3863a98 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:31.236548 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1467b309-ebe5-48a1-9012-2ed5c3863a98 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:31.237282 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1467b309-ebe5-48a1-9012-2ed5c3863a98 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:31.238049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1467b309-ebe5-48a1-9012-2ed5c3863a98 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:31.238484 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1467b309-ebe5-48a1-9012-2ed5c3863a98 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:31.370456 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1467b309-ebe5-48a1-9012-2ed5c3863a98 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:31.378423 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1467b309-ebe5-48a1-9012-2ed5c3863a98 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.152714 May 17 17:13:31.378987 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 235/504] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:31 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:32.059852 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f3014cd6-543d-46da-8c2c-b57de8aa5bbe tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:32.060538 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f3014cd6-543d-46da-8c2c-b57de8aa5bbe tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:32.067574 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3014cd6-543d-46da-8c2c-b57de8aa5bbe tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:32.068045 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3014cd6-543d-46da-8c2c-b57de8aa5bbe tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:32.068797 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3014cd6-543d-46da-8c2c-b57de8aa5bbe tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:32.069228 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3014cd6-543d-46da-8c2c-b57de8aa5bbe tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:32.198387 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f3014cd6-543d-46da-8c2c-b57de8aa5bbe tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:32.205574 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f3014cd6-543d-46da-8c2c-b57de8aa5bbe tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.149536 May 17 17:13:32.206144 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 270/505] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:32 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:32.236289 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1a1cde98-6cf8-4d24-b8da-b08272695340 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:32.236892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1a1cde98-6cf8-4d24-b8da-b08272695340 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:32.243221 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1a1cde98-6cf8-4d24-b8da-b08272695340 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:32.243754 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1a1cde98-6cf8-4d24-b8da-b08272695340 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:32.244564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1a1cde98-6cf8-4d24-b8da-b08272695340 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:32.245034 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1a1cde98-6cf8-4d24-b8da-b08272695340 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:32.378179 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1a1cde98-6cf8-4d24-b8da-b08272695340 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:32.386373 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1a1cde98-6cf8-4d24-b8da-b08272695340 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:32.387940 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1a1cde98-6cf8-4d24-b8da-b08272695340 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:32.389123 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1a1cde98-6cf8-4d24-b8da-b08272695340 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.157315 May 17 17:13:32.389727 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 236/506] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:32 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:32.394402 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-6b869023-5487-4db3-a061-472d8950115b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:32.395012 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-6b869023-5487-4db3-a061-472d8950115b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:32.400981 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6b869023-5487-4db3-a061-472d8950115b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:32.401422 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6b869023-5487-4db3-a061-472d8950115b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:32.402174 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6b869023-5487-4db3-a061-472d8950115b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:32.402601 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6b869023-5487-4db3-a061-472d8950115b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:32.529629 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-6b869023-5487-4db3-a061-472d8950115b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:32.537566 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-6b869023-5487-4db3-a061-472d8950115b tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1259 microversion: 2.1 time: 0.147157 May 17 17:13:32.538124 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 271/507] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:32 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:33.222807 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-13e3f29b-7be2-4718-857f-316c34cd7da2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:33.223340 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-13e3f29b-7be2-4718-857f-316c34cd7da2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:33.229383 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-13e3f29b-7be2-4718-857f-316c34cd7da2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:33.229828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-13e3f29b-7be2-4718-857f-316c34cd7da2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:33.230592 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-13e3f29b-7be2-4718-857f-316c34cd7da2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:33.231020 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-13e3f29b-7be2-4718-857f-316c34cd7da2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:33.363935 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-13e3f29b-7be2-4718-857f-316c34cd7da2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:33.371224 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-13e3f29b-7be2-4718-857f-316c34cd7da2 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1318 microversion: 2.1 time: 0.153068 May 17 17:13:33.371817 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 237/508] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:33 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:33.408456 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ac584ace-4e76-455d-972a-ef94c35b78f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:33.409371 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ac584ace-4e76-455d-972a-ef94c35b78f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:33.415906 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ac584ace-4e76-455d-972a-ef94c35b78f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:33.416362 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ac584ace-4e76-455d-972a-ef94c35b78f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:33.417142 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ac584ace-4e76-455d-972a-ef94c35b78f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:33.417583 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ac584ace-4e76-455d-972a-ef94c35b78f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:33.551331 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ac584ace-4e76-455d-972a-ef94c35b78f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:33.554153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9cef94f0-3113-463e-a165-b258b4dcb06f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:33.554778 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9cef94f0-3113-463e-a165-b258b4dcb06f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:33.559732 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ac584ace-4e76-455d-972a-ef94c35b78f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:33.560551 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9cef94f0-3113-463e-a165-b258b4dcb06f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:33.561012 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9cef94f0-3113-463e-a165-b258b4dcb06f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:33.561581 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ac584ace-4e76-455d-972a-ef94c35b78f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:33.561782 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9cef94f0-3113-463e-a165-b258b4dcb06f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:33.562229 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9cef94f0-3113-463e-a165-b258b4dcb06f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:33.562730 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ac584ace-4e76-455d-972a-ef94c35b78f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.159415 May 17 17:13:33.564288 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 272/509] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:33 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:33.689790 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9cef94f0-3113-463e-a165-b258b4dcb06f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:33.697200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9cef94f0-3113-463e-a165-b258b4dcb06f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1442 microversion: 2.1 time: 0.146815 May 17 17:13:33.697773 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 238/510] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:33 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1442 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:13:33.714568 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-138ccc0b-9b11-4a5e-bc0b-4c2eff564acf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:33.715288 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-138ccc0b-9b11-4a5e-bc0b-4c2eff564acf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:33.721302 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-138ccc0b-9b11-4a5e-bc0b-4c2eff564acf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:33.721762 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-138ccc0b-9b11-4a5e-bc0b-4c2eff564acf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:33.722548 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-138ccc0b-9b11-4a5e-bc0b-4c2eff564acf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:33.722986 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-138ccc0b-9b11-4a5e-bc0b-4c2eff564acf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:33.860704 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-138ccc0b-9b11-4a5e-bc0b-4c2eff564acf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:33.868119 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-138ccc0b-9b11-4a5e-bc0b-4c2eff564acf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1442 microversion: 2.1 time: 0.158090 May 17 17:13:33.868683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 273/511] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:33 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:34.388866 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d51d6043-d2fb-454e-a10b-9ac57f33991e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:34.389478 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d51d6043-d2fb-454e-a10b-9ac57f33991e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:34.395809 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d51d6043-d2fb-454e-a10b-9ac57f33991e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:34.396294 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d51d6043-d2fb-454e-a10b-9ac57f33991e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:34.397066 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d51d6043-d2fb-454e-a10b-9ac57f33991e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:34.397505 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d51d6043-d2fb-454e-a10b-9ac57f33991e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:34.578097 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d51d6043-d2fb-454e-a10b-9ac57f33991e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:34.581932 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-55a794b0-aa8a-4738-b5ce-656571f8fb84 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:34.582614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-55a794b0-aa8a-4738-b5ce-656571f8fb84 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:34.589035 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d51d6043-d2fb-454e-a10b-9ac57f33991e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1507 microversion: 2.1 time: 0.204085 May 17 17:13:34.589822 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 239/512] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:34 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:34.602187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-55a794b0-aa8a-4738-b5ce-656571f8fb84 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:34.602906 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-55a794b0-aa8a-4738-b5ce-656571f8fb84 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:34.604090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-55a794b0-aa8a-4738-b5ce-656571f8fb84 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:34.604715 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-55a794b0-aa8a-4738-b5ce-656571f8fb84 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:34.606682 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-536c6bf9-a145-4004-a4db-ffefa97f1e2e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd6528ff-1d44-4b1f-95d0-639e2c330b3e", "device": "/dev/sdb"}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:34.610586 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-536c6bf9-a145-4004-a4db-ffefa97f1e2e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:34.618489 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-536c6bf9-a145-4004-a4db-ffefa97f1e2e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:34.619205 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-536c6bf9-a145-4004-a4db-ffefa97f1e2e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:34.620189 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-536c6bf9-a145-4004-a4db-ffefa97f1e2e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:34.621204 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-536c6bf9-a145-4004-a4db-ffefa97f1e2e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:34.841571 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-55a794b0-aa8a-4738-b5ce-656571f8fb84 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:34.850685 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-55a794b0-aa8a-4738-b5ce-656571f8fb84 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:34.852210 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-55a794b0-aa8a-4738-b5ce-656571f8fb84 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:34.853446 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-55a794b0-aa8a-4738-b5ce-656571f8fb84 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.275531 May 17 17:13:34.854008 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 274/513] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:34 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:35.387106 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-536c6bf9-a145-4004-a4db-ffefa97f1e2e tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "POST /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784418 May 17 17:13:35.387731 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 240/514] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 17 17:13:34 2022] POST /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:35.872770 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ced3b9f6-2686-4148-9811-5ae9c523d421 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:35.873389 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ced3b9f6-2686-4148-9811-5ae9c523d421 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:35.879911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ced3b9f6-2686-4148-9811-5ae9c523d421 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:35.880370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ced3b9f6-2686-4148-9811-5ae9c523d421 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:35.881157 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ced3b9f6-2686-4148-9811-5ae9c523d421 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:35.881789 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ced3b9f6-2686-4148-9811-5ae9c523d421 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:36.058988 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-269efb87-c8ea-4985-95ec-e1a18fdd4352 req-5b965ca4-89d6-4e1b-ade4-eb983cd8c989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47d1426b-07f8-410e-b753-b1d8e9c1102f", "tag": "72213c8f-95d2-4e6b-bc71-ec5cf8e62273"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:36.070088 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-269efb87-c8ea-4985-95ec-e1a18fdd4352 req-5b965ca4-89d6-4e1b-ade4-eb983cd8c989 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:36.070841 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-269efb87-c8ea-4985-95ec-e1a18fdd4352 req-5b965ca4-89d6-4e1b-ade4-eb983cd8c989 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:36.084691 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-269efb87-c8ea-4985-95ec-e1a18fdd4352 req-5b965ca4-89d6-4e1b-ade4-eb983cd8c989 service nova] Creating event network-changed:72213c8f-95d2-4e6b-bc71-ec5cf8e62273 for instance 47d1426b-07f8-410e-b753-b1d8e9c1102f on hv-cinder-84214 May 17 17:13:36.096564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-269efb87-c8ea-4985-95ec-e1a18fdd4352 req-5b965ca4-89d6-4e1b-ade4-eb983cd8c989 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042793 May 17 17:13:36.097727 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 241/515] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:13:36.151534 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ced3b9f6-2686-4148-9811-5ae9c523d421 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:36.160886 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ced3b9f6-2686-4148-9811-5ae9c523d421 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:36.162382 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ced3b9f6-2686-4148-9811-5ae9c523d421 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:36.163541 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ced3b9f6-2686-4148-9811-5ae9c523d421 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.294706 May 17 17:13:36.164127 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 275/516] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:35 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:36.339243 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-19c09153-fe16-4d41-87e0-697f216584e9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Action: 'create', calling method: .version_select at 0x7feb18119dc0>, body: {"keypair": {"name": "tempest-keypair-1980803640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwg4bvg05LULyqyiJIa6tWykWAcnuFEyctai4TNqAnOUSQC/AsfDCSYqLxdyn8vRN0LEqr/goH84FhGvhEEzjVnVF+sqrd0oE9Y1GxATLaesw5boBlpX+Uz4gDD2mYvKw=="}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:36.354717 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-19c09153-fe16-4d41-87e0-697f216584e9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'key_pairs'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:13:36.358692 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-19c09153-fe16-4d41-87e0-697f216584e9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for user 61daaf70d25c4e1592fcb2f4feafff86 and project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'key_pairs'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:13:36.384856 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-19c09153-fe16-4d41-87e0-697f216584e9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049836 May 17 17:13:36.392013 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 242/517] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 17 17:13:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:37.182255 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-4f8c37c8-c4db-401c-b7af-ac8be57ce8f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:37.182898 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-4f8c37c8-c4db-401c-b7af-ac8be57ce8f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:37.189777 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4f8c37c8-c4db-401c-b7af-ac8be57ce8f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:37.190229 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4f8c37c8-c4db-401c-b7af-ac8be57ce8f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:37.190998 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4f8c37c8-c4db-401c-b7af-ac8be57ce8f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:37.191434 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4f8c37c8-c4db-401c-b7af-ac8be57ce8f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:37.402301 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-4f8c37c8-c4db-401c-b7af-ac8be57ce8f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:37.411740 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-4f8c37c8-c4db-401c-b7af-ac8be57ce8f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:37.413300 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-4f8c37c8-c4db-401c-b7af-ac8be57ce8f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:37.414491 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-4f8c37c8-c4db-401c-b7af-ac8be57ce8f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.236140 May 17 17:13:37.415268 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 276/518] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:37 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:37.818037 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-704825424", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30541785-dceb-40b7-9575-992b66a470e9"}], "security_groups": [{"name": "tempest-securitygroup--1843930141"}], "key_name": "tempest-keypair-1980803640", "user_data": "}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:37.915781 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] validate_networks() for [('30541785-dceb-40b7-9575-992b66a470e9', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:13:38.280433 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:13:38.280857 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:13:38.281903 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:13:38.282307 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:13:38.282711 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:13:38.291408 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:38.291881 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:38.292673 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:38.293111 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:38.308928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:13:38.313811 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for user 61daaf70d25c4e1592fcb2f4feafff86 and project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:13:38.325083 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:13:38.327448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:13:38.373785 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6cb42ca6-18af-4051-8835-e255341beb3b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.561165 May 17 17:13:38.374431 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 243/519] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:13:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:13:38.384858 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e459fb6e-9f3b-4ea0-bd67-b456dca333c9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:38.386035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-e459fb6e-9f3b-4ea0-bd67-b456dca333c9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:38.433840 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4f77d54f-5c60-4a68-87b5-9680306f5ccf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:38.434672 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4f77d54f-5c60-4a68-87b5-9680306f5ccf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:38.442158 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4f77d54f-5c60-4a68-87b5-9680306f5ccf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:38.442806 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4f77d54f-5c60-4a68-87b5-9680306f5ccf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:38.443768 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4f77d54f-5c60-4a68-87b5-9680306f5ccf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:38.444365 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4f77d54f-5c60-4a68-87b5-9680306f5ccf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:38.444494 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-e459fb6e-9f3b-4ea0-bd67-b456dca333c9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:38.451451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e459fb6e-9f3b-4ea0-bd67-b456dca333c9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1241 microversion: 2.1 time: 0.070386 May 17 17:13:38.452493 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 277/520] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:38 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:38.579547 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4f77d54f-5c60-4a68-87b5-9680306f5ccf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:38.596948 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4f77d54f-5c60-4a68-87b5-9680306f5ccf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:38.598458 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4f77d54f-5c60-4a68-87b5-9680306f5ccf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:38.599641 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4f77d54f-5c60-4a68-87b5-9680306f5ccf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.169860 May 17 17:13:38.600206 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 244/521] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:38 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:13:39.469333 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-862c864f-2ccd-40e2-99a3-85379632e7d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:39.469930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-862c864f-2ccd-40e2-99a3-85379632e7d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:39.478658 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-862c864f-2ccd-40e2-99a3-85379632e7d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:39.479113 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-862c864f-2ccd-40e2-99a3-85379632e7d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:39.479973 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-862c864f-2ccd-40e2-99a3-85379632e7d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:39.480413 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-862c864f-2ccd-40e2-99a3-85379632e7d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:39.557046 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-862c864f-2ccd-40e2-99a3-85379632e7d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:39.576890 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-862c864f-2ccd-40e2-99a3-85379632e7d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1293 microversion: 2.1 time: 0.111196 May 17 17:13:39.577494 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 278/522] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:39 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1293 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:39.617643 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-c2e21211-ef7a-4794-91e3-c7aaeeca2e0a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:39.619015 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-c2e21211-ef7a-4794-91e3-c7aaeeca2e0a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:39.626017 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c2e21211-ef7a-4794-91e3-c7aaeeca2e0a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:39.626760 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c2e21211-ef7a-4794-91e3-c7aaeeca2e0a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:39.627812 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c2e21211-ef7a-4794-91e3-c7aaeeca2e0a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:39.628465 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c2e21211-ef7a-4794-91e3-c7aaeeca2e0a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:39.803947 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-c2e21211-ef7a-4794-91e3-c7aaeeca2e0a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:39.813176 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-c2e21211-ef7a-4794-91e3-c7aaeeca2e0a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:39.815017 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-c2e21211-ef7a-4794-91e3-c7aaeeca2e0a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:39.816423 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-c2e21211-ef7a-4794-91e3-c7aaeeca2e0a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.202716 May 17 17:13:39.816994 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 245/523] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:39 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:40.596773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-bf002c56-e43e-47a9-8ca9-d3bee4532304 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:40.597433 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-bf002c56-e43e-47a9-8ca9-d3bee4532304 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:40.604036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf002c56-e43e-47a9-8ca9-d3bee4532304 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:40.604745 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf002c56-e43e-47a9-8ca9-d3bee4532304 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:40.605694 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf002c56-e43e-47a9-8ca9-d3bee4532304 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:40.606126 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf002c56-e43e-47a9-8ca9-d3bee4532304 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:40.751657 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-bf002c56-e43e-47a9-8ca9-d3bee4532304 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:40.758439 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-bf002c56-e43e-47a9-8ca9-d3bee4532304 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1367 microversion: 2.1 time: 0.167834 May 17 17:13:40.759019 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 279/524] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:40 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:40.834333 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9db7133c-bf47-4013-9c9b-ebc1fd22600d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:40.835074 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9db7133c-bf47-4013-9c9b-ebc1fd22600d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:40.841348 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9db7133c-bf47-4013-9c9b-ebc1fd22600d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:40.841798 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9db7133c-bf47-4013-9c9b-ebc1fd22600d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:40.842568 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9db7133c-bf47-4013-9c9b-ebc1fd22600d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:40.843011 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9db7133c-bf47-4013-9c9b-ebc1fd22600d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:40.973695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9db7133c-bf47-4013-9c9b-ebc1fd22600d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:40.983000 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9db7133c-bf47-4013-9c9b-ebc1fd22600d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:40.985153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9db7133c-bf47-4013-9c9b-ebc1fd22600d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:40.986757 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9db7133c-bf47-4013-9c9b-ebc1fd22600d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.156296 May 17 17:13:40.987614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 246/525] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:40 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:41.154466 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-8c6d45bd-b971-448f-9146-ac21805d40d7 req-08d7e422-8799-444c-beb3-c156f8ca0afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb476330-5832-4b1c-bc73-9e902cbb77b2", "tag": "aad19b71-6714-499c-a78e-11636c0b7474"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:41.179990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-8c6d45bd-b971-448f-9146-ac21805d40d7 req-08d7e422-8799-444c-beb3-c156f8ca0afb service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:41.180243 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-8c6d45bd-b971-448f-9146-ac21805d40d7 req-08d7e422-8799-444c-beb3-c156f8ca0afb service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:41.194087 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-8c6d45bd-b971-448f-9146-ac21805d40d7 req-08d7e422-8799-444c-beb3-c156f8ca0afb service nova] Creating event network-changed:aad19b71-6714-499c-a78e-11636c0b7474 for instance cb476330-5832-4b1c-bc73-9e902cbb77b2 on hv-cinder-84214 May 17 17:13:41.199547 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-8c6d45bd-b971-448f-9146-ac21805d40d7 req-08d7e422-8799-444c-beb3-c156f8ca0afb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049153 May 17 17:13:41.200451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 280/526] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:41.734167 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-deba21d2-720d-4005-aae1-68d9ff1d8fae req-d7e6e10b-01da-456f-9e1d-dfd8aeb87110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b074c961-149b-4667-addc-790568769b88", "name": "network-vif-plugged", "status": "completed", "tag": "e6735ae1-4241-48ca-9802-22aba7b4cccc"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:41.742685 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-deba21d2-720d-4005-aae1-68d9ff1d8fae req-d7e6e10b-01da-456f-9e1d-dfd8aeb87110 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:41.743361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-deba21d2-720d-4005-aae1-68d9ff1d8fae req-d7e6e10b-01da-456f-9e1d-dfd8aeb87110 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:41.756256 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-deba21d2-720d-4005-aae1-68d9ff1d8fae req-d7e6e10b-01da-456f-9e1d-dfd8aeb87110 service nova] Creating event network-vif-plugged:e6735ae1-4241-48ca-9802-22aba7b4cccc for instance b074c961-149b-4667-addc-790568769b88 on hv-cinder-84214 May 17 17:13:41.761166 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-deba21d2-720d-4005-aae1-68d9ff1d8fae req-d7e6e10b-01da-456f-9e1d-dfd8aeb87110 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030719 May 17 17:13:41.761750 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 247/527] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:41.786506 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9d231b84-a115-43d9-9eca-7b5ab3f00e4b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:41.787304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9d231b84-a115-43d9-9eca-7b5ab3f00e4b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:41.795386 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9d231b84-a115-43d9-9eca-7b5ab3f00e4b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:41.795862 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9d231b84-a115-43d9-9eca-7b5ab3f00e4b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:41.796668 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9d231b84-a115-43d9-9eca-7b5ab3f00e4b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:41.797105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9d231b84-a115-43d9-9eca-7b5ab3f00e4b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:41.932740 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9d231b84-a115-43d9-9eca-7b5ab3f00e4b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:41.940516 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9d231b84-a115-43d9-9eca-7b5ab3f00e4b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1367 microversion: 2.1 time: 0.160219 May 17 17:13:41.941082 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 281/528] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:41 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:42.005643 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8e04a610-6cc7-43d3-8c6e-530c90fd7afb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:42.006264 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8e04a610-6cc7-43d3-8c6e-530c90fd7afb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:42.012751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8e04a610-6cc7-43d3-8c6e-530c90fd7afb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:42.013198 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8e04a610-6cc7-43d3-8c6e-530c90fd7afb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:42.013955 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8e04a610-6cc7-43d3-8c6e-530c90fd7afb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:42.014419 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8e04a610-6cc7-43d3-8c6e-530c90fd7afb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:42.143626 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-8e04a610-6cc7-43d3-8c6e-530c90fd7afb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:42.151858 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-8e04a610-6cc7-43d3-8c6e-530c90fd7afb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:42.153350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-8e04a610-6cc7-43d3-8c6e-530c90fd7afb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:42.154499 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8e04a610-6cc7-43d3-8c6e-530c90fd7afb tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.153184 May 17 17:13:42.155046 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 248/529] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:41 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:42.957651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-abb86af5-231b-4960-b8a6-5bd5debc02ec tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:42.958180 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-abb86af5-231b-4960-b8a6-5bd5debc02ec tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:42.964527 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-abb86af5-231b-4960-b8a6-5bd5debc02ec tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:42.964970 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-abb86af5-231b-4960-b8a6-5bd5debc02ec tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:42.965719 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-abb86af5-231b-4960-b8a6-5bd5debc02ec tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:42.966151 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-abb86af5-231b-4960-b8a6-5bd5debc02ec tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:43.096004 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-abb86af5-231b-4960-b8a6-5bd5debc02ec tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:43.103304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-abb86af5-231b-4960-b8a6-5bd5debc02ec tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1367 microversion: 2.1 time: 0.149831 May 17 17:13:43.103901 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 282/530] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:42 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:43.173966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0a9067f7-67b6-42a2-9186-3b51216c6035 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:43.174573 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0a9067f7-67b6-42a2-9186-3b51216c6035 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:43.180881 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0a9067f7-67b6-42a2-9186-3b51216c6035 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:43.181326 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0a9067f7-67b6-42a2-9186-3b51216c6035 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:43.182080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0a9067f7-67b6-42a2-9186-3b51216c6035 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:43.182516 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0a9067f7-67b6-42a2-9186-3b51216c6035 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:43.310175 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0a9067f7-67b6-42a2-9186-3b51216c6035 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:43.319629 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0a9067f7-67b6-42a2-9186-3b51216c6035 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:43.321160 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0a9067f7-67b6-42a2-9186-3b51216c6035 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:43.322330 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0a9067f7-67b6-42a2-9186-3b51216c6035 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.152833 May 17 17:13:43.323084 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 249/531] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:43 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:44.120896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-21d8e1a8-5d5b-49f3-bc65-4e1ed5d28a81 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:44.121524 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-21d8e1a8-5d5b-49f3-bc65-4e1ed5d28a81 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:44.128490 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-21d8e1a8-5d5b-49f3-bc65-4e1ed5d28a81 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:44.128935 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-21d8e1a8-5d5b-49f3-bc65-4e1ed5d28a81 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:44.129691 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-21d8e1a8-5d5b-49f3-bc65-4e1ed5d28a81 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:44.130123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-21d8e1a8-5d5b-49f3-bc65-4e1ed5d28a81 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:44.260098 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-21d8e1a8-5d5b-49f3-bc65-4e1ed5d28a81 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:44.267421 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-21d8e1a8-5d5b-49f3-bc65-4e1ed5d28a81 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1367 microversion: 2.1 time: 0.150383 May 17 17:13:44.268017 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 283/532] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:44 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:44.341753 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-29574bd8-5ae7-452c-a1e9-f4b0e77f2360 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:44.342449 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-29574bd8-5ae7-452c-a1e9-f4b0e77f2360 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:44.349952 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29574bd8-5ae7-452c-a1e9-f4b0e77f2360 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:44.350400 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29574bd8-5ae7-452c-a1e9-f4b0e77f2360 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:44.351158 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29574bd8-5ae7-452c-a1e9-f4b0e77f2360 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:44.351590 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29574bd8-5ae7-452c-a1e9-f4b0e77f2360 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:44.482694 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-29574bd8-5ae7-452c-a1e9-f4b0e77f2360 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:44.496653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-29574bd8-5ae7-452c-a1e9-f4b0e77f2360 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:44.498707 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-29574bd8-5ae7-452c-a1e9-f4b0e77f2360 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:44.500180 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-29574bd8-5ae7-452c-a1e9-f4b0e77f2360 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.163272 May 17 17:13:44.503661 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 250/533] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:44 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:45.285459 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-86fbb4e9-e762-4ffb-9df7-70ad7fbcae32 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:45.285983 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-86fbb4e9-e762-4ffb-9df7-70ad7fbcae32 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:45.292405 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-86fbb4e9-e762-4ffb-9df7-70ad7fbcae32 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:45.292858 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-86fbb4e9-e762-4ffb-9df7-70ad7fbcae32 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:45.293628 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-86fbb4e9-e762-4ffb-9df7-70ad7fbcae32 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:45.294071 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-86fbb4e9-e762-4ffb-9df7-70ad7fbcae32 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:45.425615 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-86fbb4e9-e762-4ffb-9df7-70ad7fbcae32 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:45.432830 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-86fbb4e9-e762-4ffb-9df7-70ad7fbcae32 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1367 microversion: 2.1 time: 0.152414 May 17 17:13:45.433404 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 284/534] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:45 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:45.520172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ffcd342a-ebfd-4116-add8-2911ba626cfc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:45.520886 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ffcd342a-ebfd-4116-add8-2911ba626cfc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:45.527059 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ffcd342a-ebfd-4116-add8-2911ba626cfc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:45.527508 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ffcd342a-ebfd-4116-add8-2911ba626cfc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:45.528362 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ffcd342a-ebfd-4116-add8-2911ba626cfc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:45.528796 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ffcd342a-ebfd-4116-add8-2911ba626cfc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:45.661660 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ffcd342a-ebfd-4116-add8-2911ba626cfc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:45.670123 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ffcd342a-ebfd-4116-add8-2911ba626cfc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:45.672339 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ffcd342a-ebfd-4116-add8-2911ba626cfc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:45.673581 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ffcd342a-ebfd-4116-add8-2911ba626cfc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.157347 May 17 17:13:45.674205 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 251/535] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:45 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:46.450340 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5133277f-e378-4b69-aab8-4c97e28514ae tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:46.450886 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5133277f-e378-4b69-aab8-4c97e28514ae tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:46.457728 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5133277f-e378-4b69-aab8-4c97e28514ae tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:46.458174 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5133277f-e378-4b69-aab8-4c97e28514ae tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:46.458933 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5133277f-e378-4b69-aab8-4c97e28514ae tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:46.459371 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5133277f-e378-4b69-aab8-4c97e28514ae tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:46.585225 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5133277f-e378-4b69-aab8-4c97e28514ae tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:46.592420 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5133277f-e378-4b69-aab8-4c97e28514ae tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1367 microversion: 2.1 time: 0.146003 May 17 17:13:46.592987 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 285/536] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:46 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:46.692633 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-18c1419e-ddd7-40f4-8653-e3c1bb69001f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:46.693239 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-18c1419e-ddd7-40f4-8653-e3c1bb69001f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:46.699703 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-18c1419e-ddd7-40f4-8653-e3c1bb69001f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:46.700163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-18c1419e-ddd7-40f4-8653-e3c1bb69001f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:46.700998 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-18c1419e-ddd7-40f4-8653-e3c1bb69001f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:46.701381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-18c1419e-ddd7-40f4-8653-e3c1bb69001f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:46.832143 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-18c1419e-ddd7-40f4-8653-e3c1bb69001f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:46.841451 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-18c1419e-ddd7-40f4-8653-e3c1bb69001f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:46.843454 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-18c1419e-ddd7-40f4-8653-e3c1bb69001f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:46.844668 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-18c1419e-ddd7-40f4-8653-e3c1bb69001f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.155972 May 17 17:13:46.845231 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 252/537] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:46 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:47.610182 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-153cccd3-ffb7-4ec2-a47b-f6e77e1b0cd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:47.610804 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-153cccd3-ffb7-4ec2-a47b-f6e77e1b0cd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:47.617381 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-153cccd3-ffb7-4ec2-a47b-f6e77e1b0cd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:47.617856 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-153cccd3-ffb7-4ec2-a47b-f6e77e1b0cd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:47.618623 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-153cccd3-ffb7-4ec2-a47b-f6e77e1b0cd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:47.619058 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-153cccd3-ffb7-4ec2-a47b-f6e77e1b0cd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:47.744502 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-153cccd3-ffb7-4ec2-a47b-f6e77e1b0cd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:47.752212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-153cccd3-ffb7-4ec2-a47b-f6e77e1b0cd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1367 microversion: 2.1 time: 0.146578 May 17 17:13:47.752781 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 286/538] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:47 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:47.862273 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-57a4e391-b785-4b58-9f29-3d154beb8336 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:47.862904 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-57a4e391-b785-4b58-9f29-3d154beb8336 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:47.869258 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-57a4e391-b785-4b58-9f29-3d154beb8336 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:47.869712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-57a4e391-b785-4b58-9f29-3d154beb8336 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:47.870479 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-57a4e391-b785-4b58-9f29-3d154beb8336 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:47.870918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-57a4e391-b785-4b58-9f29-3d154beb8336 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:47.996466 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-57a4e391-b785-4b58-9f29-3d154beb8336 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:48.004669 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-57a4e391-b785-4b58-9f29-3d154beb8336 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:48.006177 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-57a4e391-b785-4b58-9f29-3d154beb8336 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:48.007323 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-57a4e391-b785-4b58-9f29-3d154beb8336 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.149105 May 17 17:13:48.007926 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 253/539] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:47 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:48.768912 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-95bd5568-b7b8-426c-806e-16b711c6c125 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:48.769541 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-95bd5568-b7b8-426c-806e-16b711c6c125 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:48.775873 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-95bd5568-b7b8-426c-806e-16b711c6c125 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:48.776315 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-95bd5568-b7b8-426c-806e-16b711c6c125 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:48.777065 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-95bd5568-b7b8-426c-806e-16b711c6c125 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:48.777496 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-95bd5568-b7b8-426c-806e-16b711c6c125 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:48.912906 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-95bd5568-b7b8-426c-806e-16b711c6c125 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:48.920307 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-95bd5568-b7b8-426c-806e-16b711c6c125 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1367 microversion: 2.1 time: 0.155153 May 17 17:13:48.920927 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 287/540] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:48 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:49.026259 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b4483e53-5de5-4abf-81cf-b6ca61f2946d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:49.026956 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-b4483e53-5de5-4abf-81cf-b6ca61f2946d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:49.034097 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b4483e53-5de5-4abf-81cf-b6ca61f2946d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:49.034553 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b4483e53-5de5-4abf-81cf-b6ca61f2946d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:49.035330 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b4483e53-5de5-4abf-81cf-b6ca61f2946d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:49.035799 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b4483e53-5de5-4abf-81cf-b6ca61f2946d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:49.162666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-b4483e53-5de5-4abf-81cf-b6ca61f2946d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:49.172354 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-b4483e53-5de5-4abf-81cf-b6ca61f2946d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:49.174477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-b4483e53-5de5-4abf-81cf-b6ca61f2946d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:49.175350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-b4483e53-5de5-4abf-81cf-b6ca61f2946d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.153005 May 17 17:13:49.176022 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 254/541] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:49 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:49.937892 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1d585a40-f5f0-4e50-84f3-760efeb5a559 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:49.938496 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1d585a40-f5f0-4e50-84f3-760efeb5a559 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:49.945122 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1d585a40-f5f0-4e50-84f3-760efeb5a559 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:49.945576 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1d585a40-f5f0-4e50-84f3-760efeb5a559 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:49.946396 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1d585a40-f5f0-4e50-84f3-760efeb5a559 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:49.946837 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1d585a40-f5f0-4e50-84f3-760efeb5a559 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:50.075090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1d585a40-f5f0-4e50-84f3-760efeb5a559 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:50.082997 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1d585a40-f5f0-4e50-84f3-760efeb5a559 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1367 microversion: 2.1 time: 0.148985 May 17 17:13:50.083554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 288/542] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:49 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:50.193551 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6b7b7989-7247-4381-9901-a07f22fe853d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:50.194186 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6b7b7989-7247-4381-9901-a07f22fe853d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:50.200430 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6b7b7989-7247-4381-9901-a07f22fe853d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:50.200860 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6b7b7989-7247-4381-9901-a07f22fe853d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:50.201614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6b7b7989-7247-4381-9901-a07f22fe853d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:50.202046 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6b7b7989-7247-4381-9901-a07f22fe853d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:50.329560 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6b7b7989-7247-4381-9901-a07f22fe853d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:50.337726 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6b7b7989-7247-4381-9901-a07f22fe853d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:50.339412 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6b7b7989-7247-4381-9901-a07f22fe853d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:50.340970 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6b7b7989-7247-4381-9901-a07f22fe853d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.151112 May 17 17:13:50.341568 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 255/543] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:50 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:51.099739 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e2ffb797-b0f9-415b-adcd-275bc5ec102c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:51.100368 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-e2ffb797-b0f9-415b-adcd-275bc5ec102c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:51.106666 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e2ffb797-b0f9-415b-adcd-275bc5ec102c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:51.107124 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e2ffb797-b0f9-415b-adcd-275bc5ec102c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:51.107911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e2ffb797-b0f9-415b-adcd-275bc5ec102c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:51.108347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e2ffb797-b0f9-415b-adcd-275bc5ec102c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:51.238264 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-e2ffb797-b0f9-415b-adcd-275bc5ec102c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:51.245542 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e2ffb797-b0f9-415b-adcd-275bc5ec102c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1367 microversion: 2.1 time: 0.149671 May 17 17:13:51.246101 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 289/544] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:51 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:51.359225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-5dfeac44-d6e5-4725-a4d1-01cb0e287f72 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:51.359769 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-5dfeac44-d6e5-4725-a4d1-01cb0e287f72 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:51.366754 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5dfeac44-d6e5-4725-a4d1-01cb0e287f72 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:51.367227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5dfeac44-d6e5-4725-a4d1-01cb0e287f72 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:51.368009 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5dfeac44-d6e5-4725-a4d1-01cb0e287f72 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:51.368444 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5dfeac44-d6e5-4725-a4d1-01cb0e287f72 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:51.494239 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5dfeac44-d6e5-4725-a4d1-01cb0e287f72 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:51.502589 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5dfeac44-d6e5-4725-a4d1-01cb0e287f72 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:51.504238 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5dfeac44-d6e5-4725-a4d1-01cb0e287f72 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:51.505388 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-5dfeac44-d6e5-4725-a4d1-01cb0e287f72 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.150158 May 17 17:13:51.505945 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 256/545] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:51 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:52.262801 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-48976c21-af25-4b5e-963d-71e5f14aa79f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:52.263537 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-48976c21-af25-4b5e-963d-71e5f14aa79f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:52.269926 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-48976c21-af25-4b5e-963d-71e5f14aa79f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:52.270374 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-48976c21-af25-4b5e-963d-71e5f14aa79f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:52.271139 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-48976c21-af25-4b5e-963d-71e5f14aa79f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:52.271572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-48976c21-af25-4b5e-963d-71e5f14aa79f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:52.397339 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-48976c21-af25-4b5e-963d-71e5f14aa79f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:52.404628 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-48976c21-af25-4b5e-963d-71e5f14aa79f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1367 microversion: 2.1 time: 0.145861 May 17 17:13:52.405203 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 290/546] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:52 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:13:52.523013 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0ec4adc7-73cc-46d9-84b6-3f7f424962ca tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:52.523648 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0ec4adc7-73cc-46d9-84b6-3f7f424962ca tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:52.529951 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0ec4adc7-73cc-46d9-84b6-3f7f424962ca tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:52.530401 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0ec4adc7-73cc-46d9-84b6-3f7f424962ca tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:52.531195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0ec4adc7-73cc-46d9-84b6-3f7f424962ca tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:52.531666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0ec4adc7-73cc-46d9-84b6-3f7f424962ca tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:52.662303 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0ec4adc7-73cc-46d9-84b6-3f7f424962ca tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:52.670508 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0ec4adc7-73cc-46d9-84b6-3f7f424962ca tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:52.672023 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0ec4adc7-73cc-46d9-84b6-3f7f424962ca tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:52.673164 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0ec4adc7-73cc-46d9-84b6-3f7f424962ca tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1809 microversion: 2.20 time: 0.154000 May 17 17:13:52.673724 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 257/547] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:52 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:52.878347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-b3fe8635-049c-4588-8a7f-0cb7cc6095a5 req-db23f906-cb7c-474b-ba13-aade348c454b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb476330-5832-4b1c-bc73-9e902cbb77b2", "name": "network-vif-plugged", "status": "completed", "tag": "aad19b71-6714-499c-a78e-11636c0b7474"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:52.886969 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-b3fe8635-049c-4588-8a7f-0cb7cc6095a5 req-db23f906-cb7c-474b-ba13-aade348c454b service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:52.887415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-b3fe8635-049c-4588-8a7f-0cb7cc6095a5 req-db23f906-cb7c-474b-ba13-aade348c454b service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:52.900567 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-b3fe8635-049c-4588-8a7f-0cb7cc6095a5 req-db23f906-cb7c-474b-ba13-aade348c454b service nova] Creating event network-vif-plugged:aad19b71-6714-499c-a78e-11636c0b7474 for instance cb476330-5832-4b1c-bc73-9e902cbb77b2 on hv-cinder-84214 May 17 17:13:52.905554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-b3fe8635-049c-4588-8a7f-0cb7cc6095a5 req-db23f906-cb7c-474b-ba13-aade348c454b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031524 May 17 17:13:52.906153 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 291/548] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:53.422394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e6f331cb-ce9f-4e97-a9e7-0d08db69f8dc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:53.422939 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e6f331cb-ce9f-4e97-a9e7-0d08db69f8dc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:53.429665 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e6f331cb-ce9f-4e97-a9e7-0d08db69f8dc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:53.430112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e6f331cb-ce9f-4e97-a9e7-0d08db69f8dc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:53.430879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e6f331cb-ce9f-4e97-a9e7-0d08db69f8dc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:53.431312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e6f331cb-ce9f-4e97-a9e7-0d08db69f8dc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:53.560115 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e6f331cb-ce9f-4e97-a9e7-0d08db69f8dc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:53.567624 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e6f331cb-ce9f-4e97-a9e7-0d08db69f8dc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1367 microversion: 2.1 time: 0.149120 May 17 17:13:53.568212 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 258/549] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:53 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:53.693148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-03488ea4-a0ef-4d1f-b1f4-01b16a32e840 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:53.693768 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-03488ea4-a0ef-4d1f-b1f4-01b16a32e840 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:53.699814 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-03488ea4-a0ef-4d1f-b1f4-01b16a32e840 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:53.700295 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-03488ea4-a0ef-4d1f-b1f4-01b16a32e840 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:53.701051 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-03488ea4-a0ef-4d1f-b1f4-01b16a32e840 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:53.701494 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-03488ea4-a0ef-4d1f-b1f4-01b16a32e840 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:53.835010 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-03488ea4-a0ef-4d1f-b1f4-01b16a32e840 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:53.843118 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-03488ea4-a0ef-4d1f-b1f4-01b16a32e840 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:53.844667 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-03488ea4-a0ef-4d1f-b1f4-01b16a32e840 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:53.845801 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-03488ea4-a0ef-4d1f-b1f4-01b16a32e840 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1796 microversion: 2.20 time: 0.157623 May 17 17:13:53.846559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 292/550] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:13:53 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1796 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:13:54.585251 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3b639122-acad-453e-a50a-ae59a5216d5d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:54.585867 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3b639122-acad-453e-a50a-ae59a5216d5d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:54.592188 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3b639122-acad-453e-a50a-ae59a5216d5d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:54.592638 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3b639122-acad-453e-a50a-ae59a5216d5d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:54.593397 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3b639122-acad-453e-a50a-ae59a5216d5d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:54.593828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3b639122-acad-453e-a50a-ae59a5216d5d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:54.726262 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3b639122-acad-453e-a50a-ae59a5216d5d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:54.733465 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3b639122-acad-453e-a50a-ae59a5216d5d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1367 microversion: 2.1 time: 0.152850 May 17 17:13:54.734015 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 259/551] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:54 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:55.749974 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-87c304bf-eca7-4275-85b9-8ba79b41e388 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:55.750586 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-87c304bf-eca7-4275-85b9-8ba79b41e388 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:55.757570 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-87c304bf-eca7-4275-85b9-8ba79b41e388 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:55.758020 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-87c304bf-eca7-4275-85b9-8ba79b41e388 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:55.758790 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-87c304bf-eca7-4275-85b9-8ba79b41e388 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:55.759231 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-87c304bf-eca7-4275-85b9-8ba79b41e388 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:55.887798 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-87c304bf-eca7-4275-85b9-8ba79b41e388 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:55.895213 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-87c304bf-eca7-4275-85b9-8ba79b41e388 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1367 microversion: 2.1 time: 0.148957 May 17 17:13:55.895811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 293/552] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:55 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:13:56.846453 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a3ec33a7-287a-492a-b39c-a4c0f695789c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:56.847029 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a3ec33a7-287a-492a-b39c-a4c0f695789c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:56.854346 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a3ec33a7-287a-492a-b39c-a4c0f695789c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:56.854805 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a3ec33a7-287a-492a-b39c-a4c0f695789c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:56.855580 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a3ec33a7-287a-492a-b39c-a4c0f695789c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:56.856048 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a3ec33a7-287a-492a-b39c-a4c0f695789c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:56.912282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-007b2a14-c1a9-4a09-8216-f42202f00c93 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:56.912897 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-007b2a14-c1a9-4a09-8216-f42202f00c93 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:56.919074 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-007b2a14-c1a9-4a09-8216-f42202f00c93 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:56.919521 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-007b2a14-c1a9-4a09-8216-f42202f00c93 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:56.920381 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-007b2a14-c1a9-4a09-8216-f42202f00c93 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:56.920815 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-007b2a14-c1a9-4a09-8216-f42202f00c93 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:56.985583 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-a3ec33a7-287a-492a-b39c-a4c0f695789c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lazy-loading 'services' on Instance uuid f6612e19-6897-484d-85df-fbd505399146 {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:13:57.057088 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-007b2a14-c1a9-4a09-8216-f42202f00c93 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:57.064413 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-007b2a14-c1a9-4a09-8216-f42202f00c93 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1558 microversion: 2.1 time: 0.157307 May 17 17:13:57.065060 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 294/553] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:56 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:13:57.082436 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a7652922-1724-49e1-a1aa-0ed6244136cf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:57.083050 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a7652922-1724-49e1-a1aa-0ed6244136cf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:57.089242 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a7652922-1724-49e1-a1aa-0ed6244136cf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:57.089905 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a7652922-1724-49e1-a1aa-0ed6244136cf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:57.090685 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a7652922-1724-49e1-a1aa-0ed6244136cf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:57.091117 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a7652922-1724-49e1-a1aa-0ed6244136cf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:57.102393 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a3ec33a7-287a-492a-b39c-a4c0f695789c tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146/os-volume_attachments/bd6528ff-1d44-4b1f-95d0-639e2c330b3e" status: 202 len: 0 microversion: 2.1 time: 0.259672 May 17 17:13:57.103332 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 260/554] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 17 17:13:56 2022] DELETE /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146/os-volume_attachments/bd6528ff-1d44-4b1f-95d0-639e2c330b3e => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:13:57.177294 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a7652922-1724-49e1-a1aa-0ed6244136cf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099793 May 17 17:13:57.177893 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 295/555] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 17 17:13:57 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:13:58.289435 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-0f4d3fb1-59fb-4f5a-8a73-bda923bdf67c req-a1637dcf-90c2-4e18-ba68-93b359591f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb476330-5832-4b1c-bc73-9e902cbb77b2", "tag": "aad19b71-6714-499c-a78e-11636c0b7474"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:58.298967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-0f4d3fb1-59fb-4f5a-8a73-bda923bdf67c req-a1637dcf-90c2-4e18-ba68-93b359591f40 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:58.299702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-0f4d3fb1-59fb-4f5a-8a73-bda923bdf67c req-a1637dcf-90c2-4e18-ba68-93b359591f40 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:58.310437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-0f4d3fb1-59fb-4f5a-8a73-bda923bdf67c req-a1637dcf-90c2-4e18-ba68-93b359591f40 service nova] Creating event network-changed:aad19b71-6714-499c-a78e-11636c0b7474 for instance cb476330-5832-4b1c-bc73-9e902cbb77b2 on hv-cinder-84214 May 17 17:13:58.315364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-0f4d3fb1-59fb-4f5a-8a73-bda923bdf67c req-a1637dcf-90c2-4e18-ba68-93b359591f40 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031253 May 17 17:13:58.316338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 261/556] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:13:59.274163 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5a4e7ec9-f656-4d38-b386-09ff4d0ccb5f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:59.274715 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5a4e7ec9-f656-4d38-b386-09ff4d0ccb5f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:59.280927 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5a4e7ec9-f656-4d38-b386-09ff4d0ccb5f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:59.281626 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5a4e7ec9-f656-4d38-b386-09ff4d0ccb5f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:59.282394 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5a4e7ec9-f656-4d38-b386-09ff4d0ccb5f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:59.282824 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5a4e7ec9-f656-4d38-b386-09ff4d0ccb5f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:59.309832 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5a4e7ec9-f656-4d38-b386-09ff4d0ccb5f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Going to try to terminate instance {{(pid=117090) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:13:59.381748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5a4e7ec9-f656-4d38-b386-09ff4d0ccb5f tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 204 len: 0 microversion: 2.1 time: 0.111673 May 17 17:13:59.382577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 296/557] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:13:59 2022] DELETE /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:13:59.391182 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3f7bae00-9918-4622-8bf2-60454aebaa28 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:13:59.391897 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3f7bae00-9918-4622-8bf2-60454aebaa28 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:59.398632 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3f7bae00-9918-4622-8bf2-60454aebaa28 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:59.399087 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3f7bae00-9918-4622-8bf2-60454aebaa28 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:59.399888 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3f7bae00-9918-4622-8bf2-60454aebaa28 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:59.400328 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3f7bae00-9918-4622-8bf2-60454aebaa28 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:59.451298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a853b4bb-fb95-4064-8fe1-09d8bfa2f972 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4830ef3-1ab3-4c9c-958c-d8b1178888ff"}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:13:59.452455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a853b4bb-fb95-4064-8fe1-09d8bfa2f972 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:13:59.458363 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a853b4bb-fb95-4064-8fe1-09d8bfa2f972 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:59.458811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a853b4bb-fb95-4064-8fe1-09d8bfa2f972 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:59.459572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a853b4bb-fb95-4064-8fe1-09d8bfa2f972 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:13:59.460030 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a853b4bb-fb95-4064-8fe1-09d8bfa2f972 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:13:59.532190 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3f7bae00-9918-4622-8bf2-60454aebaa28 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:13:59.540894 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3f7bae00-9918-4622-8bf2-60454aebaa28 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1513 microversion: 2.1 time: 0.153814 May 17 17:13:59.541470 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 262/558] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:13:59 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:00.558821 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-830c662c-e949-4ea9-9bee-c9ba2d8ee7be tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:00.559457 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-830c662c-e949-4ea9-9bee-c9ba2d8ee7be tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:00.565855 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-830c662c-e949-4ea9-9bee-c9ba2d8ee7be tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:00.566299 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-830c662c-e949-4ea9-9bee-c9ba2d8ee7be tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:00.567070 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-830c662c-e949-4ea9-9bee-c9ba2d8ee7be tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:00.567561 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-830c662c-e949-4ea9-9bee-c9ba2d8ee7be tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:00.695423 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-830c662c-e949-4ea9-9bee-c9ba2d8ee7be tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:00.702760 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-830c662c-e949-4ea9-9bee-c9ba2d8ee7be tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1513 microversion: 2.1 time: 0.147891 May 17 17:14:00.703325 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 263/559] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:00 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:01.513616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a853b4bb-fb95-4064-8fe1-09d8bfa2f972 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "POST /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.066439 May 17 17:14:01.514369 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 297/560] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 17 17:13:59 2022] POST /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-volume_attachments => generated 194 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:14:01.720625 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-08836768-fc00-45da-a73a-c80518caeda7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:01.721169 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-08836768-fc00-45da-a73a-c80518caeda7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:01.727446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-08836768-fc00-45da-a73a-c80518caeda7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:01.727929 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-08836768-fc00-45da-a73a-c80518caeda7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:01.728687 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-08836768-fc00-45da-a73a-c80518caeda7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:01.729127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-08836768-fc00-45da-a73a-c80518caeda7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:01.856970 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-08836768-fc00-45da-a73a-c80518caeda7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b9ce69a40845c5adef40e3e0355747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260311245b60460283c01ebc87cb5bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:01.865726 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-08836768-fc00-45da-a73a-c80518caeda7 tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 200 len: 1513 microversion: 2.1 time: 0.148936 May 17 17:14:01.866537 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 264/561] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:01 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:02.326111 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-c5da2c5f-cd7c-48ef-8c12-87a06c172834 req-e168fe4c-2651-4d73-94d4-72c84cf4242e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6612e19-6897-484d-85df-fbd505399146", "name": "network-vif-deleted", "tag": "f2f7cadc-2d7c-4ce1-9fa9-fbab98a5ecdf"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:02.335341 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-c5da2c5f-cd7c-48ef-8c12-87a06c172834 req-e168fe4c-2651-4d73-94d4-72c84cf4242e service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:02.335910 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-c5da2c5f-cd7c-48ef-8c12-87a06c172834 req-e168fe4c-2651-4d73-94d4-72c84cf4242e service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:02.348076 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-c5da2c5f-cd7c-48ef-8c12-87a06c172834 req-e168fe4c-2651-4d73-94d4-72c84cf4242e service nova] Creating event network-vif-deleted:f2f7cadc-2d7c-4ce1-9fa9-fbab98a5ecdf for instance f6612e19-6897-484d-85df-fbd505399146 on hv-cinder-84214 May 17 17:14:02.352901 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-c5da2c5f-cd7c-48ef-8c12-87a06c172834 req-e168fe4c-2651-4d73-94d4-72c84cf4242e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031529 May 17 17:14:02.353493 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 298/562] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:14:02.882986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9d8aa9fa-3c0e-43e5-b0bf-6e0de6f4c63d tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:02.883734 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9d8aa9fa-3c0e-43e5-b0bf-6e0de6f4c63d tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] [instance: f6612e19-6897-484d-85df-fbd505399146] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:02.890270 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9d8aa9fa-3c0e-43e5-b0bf-6e0de6f4c63d tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:02.890727 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9d8aa9fa-3c0e-43e5-b0bf-6e0de6f4c63d tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:02.891558 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9d8aa9fa-3c0e-43e5-b0bf-6e0de6f4c63d tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:02.892025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9d8aa9fa-3c0e-43e5-b0bf-6e0de6f4c63d tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:02.905531 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-9d8aa9fa-3c0e-43e5-b0bf-6e0de6f4c63d tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] HTTP exception thrown: Instance f6612e19-6897-484d-85df-fbd505399146 could not be found. May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9d8aa9fa-3c0e-43e5-b0bf-6e0de6f4c63d tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Request method failure captured: May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 HTTP/1.1 May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9dODP0bMLXtc5_2gFDRQQlbMlB6GchrefIxCll4qkPZWdJe62W4_5KWP9kjBDlzrur3XEZHCLJn9sYQ9X8GPBjdIIELqr50sf8rR6qYOejxPr2WC64_J6LdBjl_zbfkVUwu1OJxc0kJG1KfXYmIT6mI96HjoBTQXPOdQAa7_DGmvV8 May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 260311245b60460283c01ebc87cb5bc2 May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1163535666 May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:14:02.907172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:14:02.909102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260311245b60460283c01ebc87cb5bc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_260311245b60460283c01ebc87cb5bc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/260311245b60460283c01ebc87cb5bc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260311245b60460283c01ebc87cb5bc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:14:02.909102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-VolumesSnapshotTestJSON-1163535666 May 17 17:14:02.909102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 260311245b60460283c01ebc87cb5bc2 May 17 17:14:02.909102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1163535666 May 17 17:14:02.909102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-VolumesSnapshotTestJSON-1163535666-project May 17 17:14:02.909102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:14:02.909102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:14:02.909102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: d7b9ce69a40845c5adef40e3e0355747 May 17 17:14:02.909102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-VolumesSnapshotTestJSON-1163535666-project May 17 17:14:02.909102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:14:02.909102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance f6612e19-6897-484d-85df-fbd505399146 could not be found. May 17 17:14:02.909102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': 'f6612e19-6897-484d-85df-fbd505399146'} May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6612e19-6897-484d-85df-fbd505399146 could not be found. May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:14:02.909924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6612e19-6897-484d-85df-fbd505399146 could not be found. May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6612e19-6897-484d-85df-fbd505399146 could not be found. May 17 17:14:02.911172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:02.912327 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9d8aa9fa-3c0e-43e5-b0bf-6e0de6f4c63d tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] Returning 404 to user: Instance f6612e19-6897-484d-85df-fbd505399146 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:14:02.912327 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9d8aa9fa-3c0e-43e5-b0bf-6e0de6f4c63d tempest-VolumesSnapshotTestJSON-1163535666 tempest-VolumesSnapshotTestJSON-1163535666-project] 10.222.0.48 "GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146" status: 404 len: 111 microversion: 2.1 time: 0.030501 May 17 17:14:02.912327 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 265/563] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:02 2022] GET /compute/v2.1/servers/f6612e19-6897-484d-85df-fbd505399146 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:14:03.604386 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e56c888b-ed42-4702-9354-ce05b1329057 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:03.604950 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-e56c888b-ed42-4702-9354-ce05b1329057 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:03.611191 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e56c888b-ed42-4702-9354-ce05b1329057 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:03.611670 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e56c888b-ed42-4702-9354-ce05b1329057 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:03.612659 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e56c888b-ed42-4702-9354-ce05b1329057 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:03.612897 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e56c888b-ed42-4702-9354-ce05b1329057 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:03.693708 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-e56c888b-ed42-4702-9354-ce05b1329057 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lazy-loading 'services' on Instance uuid ee2bb8d5-d263-4ab1-8778-77fc4a30f388 {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:14:03.931767 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e56c888b-ed42-4702-9354-ce05b1329057 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/os-volume_attachments/04fcdc72-fdad-4ffc-adb5-93fcd017f601" status: 202 len: 0 microversion: 2.1 time: 0.331923 May 17 17:14:03.932420 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 299/564] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 17 17:14:03 2022] DELETE /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/os-volume_attachments/04fcdc72-fdad-4ffc-adb5-93fcd017f601 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:14:08.993312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9126fcff-7480-4438-949d-ba5566dd36e1 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:08.994194 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9126fcff-7480-4438-949d-ba5566dd36e1 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:09.000566 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9126fcff-7480-4438-949d-ba5566dd36e1 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:09.001024 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9126fcff-7480-4438-949d-ba5566dd36e1 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:09.001801 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9126fcff-7480-4438-949d-ba5566dd36e1 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:09.002246 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9126fcff-7480-4438-949d-ba5566dd36e1 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:09.026088 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-9126fcff-7480-4438-949d-ba5566dd36e1 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lazy-loading 'flavor' on Instance uuid 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:14:09.151862 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9126fcff-7480-4438-949d-ba5566dd36e1 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "POST /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/action" status: 200 len: 32 microversion: 2.1 time: 0.162596 May 17 17:14:09.152467 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 266/565] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 17 17:14:08 2022] POST /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 17:14:09.162702 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-488191bf-03dd-4080-8ff6-74b05c8d982b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:09.163402 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-488191bf-03dd-4080-8ff6-74b05c8d982b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:09.169642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-488191bf-03dd-4080-8ff6-74b05c8d982b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:09.170337 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-488191bf-03dd-4080-8ff6-74b05c8d982b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:09.171119 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-488191bf-03dd-4080-8ff6-74b05c8d982b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:09.171583 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-488191bf-03dd-4080-8ff6-74b05c8d982b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:09.305740 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-488191bf-03dd-4080-8ff6-74b05c8d982b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:09.313892 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-488191bf-03dd-4080-8ff6-74b05c8d982b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.156042 May 17 17:14:09.314670 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 300/566] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:09 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:10.312415 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-68af934f-3a91-414c-b3b7-bd072d2f765d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:10.319268 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-68af934f-3a91-414c-b3b7-bd072d2f765d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:10.319748 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-68af934f-3a91-414c-b3b7-bd072d2f765d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:10.332541 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-27fc1575-9c14-4cee-be02-2f20123f5705 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:10.333319 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-27fc1575-9c14-4cee-be02-2f20123f5705 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:10.339537 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-27fc1575-9c14-4cee-be02-2f20123f5705 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:10.340164 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-27fc1575-9c14-4cee-be02-2f20123f5705 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:10.340989 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-27fc1575-9c14-4cee-be02-2f20123f5705 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:10.341582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-27fc1575-9c14-4cee-be02-2f20123f5705 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:10.345160 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-68af934f-3a91-414c-b3b7-bd072d2f765d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Going to try to stop instance {{(pid=117089) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 17 17:14:10.389626 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-68af934f-3a91-414c-b3b7-bd072d2f765d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "POST /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/action" status: 202 len: 0 microversion: 2.1 time: 0.082611 May 17 17:14:10.390256 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 267/567] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 17 17:14:10 2022] POST /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:14:10.399284 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a0920c65-a3da-4f07-b167-9a5bab89af98 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:10.400025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a0920c65-a3da-4f07-b167-9a5bab89af98 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:10.406870 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a0920c65-a3da-4f07-b167-9a5bab89af98 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:10.407441 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a0920c65-a3da-4f07-b167-9a5bab89af98 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:10.408587 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a0920c65-a3da-4f07-b167-9a5bab89af98 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:10.409034 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a0920c65-a3da-4f07-b167-9a5bab89af98 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:10.530185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-27fc1575-9c14-4cee-be02-2f20123f5705 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:10.540334 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-27fc1575-9c14-4cee-be02-2f20123f5705 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.212063 May 17 17:14:10.541497 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 301/568] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:10 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:10.576811 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a0920c65-a3da-4f07-b167-9a5bab89af98 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:10.585253 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a0920c65-a3da-4f07-b167-9a5bab89af98 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1677 microversion: 2.1 time: 0.189918 May 17 17:14:10.585829 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 268/569] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:10 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:11.559626 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-90b4fb1c-ab05-46a9-a003-0cb541f33cef tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:11.560270 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-90b4fb1c-ab05-46a9-a003-0cb541f33cef tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:11.566894 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90b4fb1c-ab05-46a9-a003-0cb541f33cef tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:11.567332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90b4fb1c-ab05-46a9-a003-0cb541f33cef tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:11.568175 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90b4fb1c-ab05-46a9-a003-0cb541f33cef tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:11.568639 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90b4fb1c-ab05-46a9-a003-0cb541f33cef tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:11.603019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a454d4e4-c706-42f3-beac-243f65706d60 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:11.603643 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a454d4e4-c706-42f3-beac-243f65706d60 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:11.610045 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a454d4e4-c706-42f3-beac-243f65706d60 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:11.610724 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a454d4e4-c706-42f3-beac-243f65706d60 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:11.611497 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a454d4e4-c706-42f3-beac-243f65706d60 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:11.611974 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a454d4e4-c706-42f3-beac-243f65706d60 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:11.748116 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-90b4fb1c-ab05-46a9-a003-0cb541f33cef tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:11.756760 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-90b4fb1c-ab05-46a9-a003-0cb541f33cef tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.200946 May 17 17:14:11.757339 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 302/570] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:11 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:11.774819 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a454d4e4-c706-42f3-beac-243f65706d60 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:11.782156 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a454d4e4-c706-42f3-beac-243f65706d60 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1677 microversion: 2.1 time: 0.182967 May 17 17:14:11.782714 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 269/571] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:11 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:12.774587 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a6375159-0ac3-4895-ae97-356122118018 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:12.775225 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a6375159-0ac3-4895-ae97-356122118018 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:12.781660 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a6375159-0ac3-4895-ae97-356122118018 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:12.782116 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a6375159-0ac3-4895-ae97-356122118018 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:12.783145 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a6375159-0ac3-4895-ae97-356122118018 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:12.783580 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a6375159-0ac3-4895-ae97-356122118018 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:12.800781 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e5b08b05-e22c-461d-bf2e-4c119b644e73 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:12.801704 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e5b08b05-e22c-461d-bf2e-4c119b644e73 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:12.807268 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e5b08b05-e22c-461d-bf2e-4c119b644e73 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:12.807756 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e5b08b05-e22c-461d-bf2e-4c119b644e73 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:12.808522 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e5b08b05-e22c-461d-bf2e-4c119b644e73 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:12.808953 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e5b08b05-e22c-461d-bf2e-4c119b644e73 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:12.997988 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a6375159-0ac3-4895-ae97-356122118018 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:13.002224 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e5b08b05-e22c-461d-bf2e-4c119b644e73 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:13.007159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a6375159-0ac3-4895-ae97-356122118018 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.236346 May 17 17:14:13.007757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 303/572] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:12 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:13.011469 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e5b08b05-e22c-461d-bf2e-4c119b644e73 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1677 microversion: 2.1 time: 0.214467 May 17 17:14:13.012217 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 270/573] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:12 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:14.024913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-193961fc-94de-46c2-9ddd-a14ad39b4959 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:14.025528 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-193961fc-94de-46c2-9ddd-a14ad39b4959 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:14.029557 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6c4d93ac-524f-4b58-9bd9-1564608ef94d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:14.030221 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6c4d93ac-524f-4b58-9bd9-1564608ef94d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:14.032055 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-193961fc-94de-46c2-9ddd-a14ad39b4959 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:14.032506 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-193961fc-94de-46c2-9ddd-a14ad39b4959 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:14.033536 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-193961fc-94de-46c2-9ddd-a14ad39b4959 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:14.033968 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-193961fc-94de-46c2-9ddd-a14ad39b4959 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:14.037088 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6c4d93ac-524f-4b58-9bd9-1564608ef94d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:14.037532 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6c4d93ac-524f-4b58-9bd9-1564608ef94d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:14.038297 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6c4d93ac-524f-4b58-9bd9-1564608ef94d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:14.038728 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6c4d93ac-524f-4b58-9bd9-1564608ef94d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:14.233546 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-193961fc-94de-46c2-9ddd-a14ad39b4959 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:14.236066 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6c4d93ac-524f-4b58-9bd9-1564608ef94d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:14.241906 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-193961fc-94de-46c2-9ddd-a14ad39b4959 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.220798 May 17 17:14:14.242565 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 304/574] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:14 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:14.243770 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6c4d93ac-524f-4b58-9bd9-1564608ef94d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1677 microversion: 2.1 time: 0.218066 May 17 17:14:14.244335 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 271/575] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:14 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:15.259364 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-600c2e53-9492-45b3-9617-6d0b96bfeef0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:15.260083 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-600c2e53-9492-45b3-9617-6d0b96bfeef0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:15.260451 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-07105b02-4f23-4f17-b904-77bf26a8ac2b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:15.261183 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-07105b02-4f23-4f17-b904-77bf26a8ac2b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:15.267211 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-600c2e53-9492-45b3-9617-6d0b96bfeef0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:15.267421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-07105b02-4f23-4f17-b904-77bf26a8ac2b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:15.267697 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-600c2e53-9492-45b3-9617-6d0b96bfeef0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:15.267892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-07105b02-4f23-4f17-b904-77bf26a8ac2b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:15.268487 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-600c2e53-9492-45b3-9617-6d0b96bfeef0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:15.268657 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-07105b02-4f23-4f17-b904-77bf26a8ac2b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:15.268974 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-600c2e53-9492-45b3-9617-6d0b96bfeef0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:15.269098 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-07105b02-4f23-4f17-b904-77bf26a8ac2b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:15.467490 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-07105b02-4f23-4f17-b904-77bf26a8ac2b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:15.470595 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-600c2e53-9492-45b3-9617-6d0b96bfeef0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:15.476203 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-07105b02-4f23-4f17-b904-77bf26a8ac2b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1677 microversion: 2.1 time: 0.219505 May 17 17:14:15.476796 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 272/576] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:15 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:15.479675 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-600c2e53-9492-45b3-9617-6d0b96bfeef0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.224637 May 17 17:14:15.480288 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 305/577] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:15 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:16.494670 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9ee3a9db-e4bc-48ee-9755-e4e776f97e4f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:16.495216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9ee3a9db-e4bc-48ee-9755-e4e776f97e4f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:16.496925 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-aed226b6-70fb-4425-b52c-bb5d3d029aa7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:16.497617 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-aed226b6-70fb-4425-b52c-bb5d3d029aa7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:16.501843 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9ee3a9db-e4bc-48ee-9755-e4e776f97e4f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:16.502297 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9ee3a9db-e4bc-48ee-9755-e4e776f97e4f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:16.503077 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9ee3a9db-e4bc-48ee-9755-e4e776f97e4f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:16.503518 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9ee3a9db-e4bc-48ee-9755-e4e776f97e4f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:16.504658 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aed226b6-70fb-4425-b52c-bb5d3d029aa7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:16.505156 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aed226b6-70fb-4425-b52c-bb5d3d029aa7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:16.506104 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aed226b6-70fb-4425-b52c-bb5d3d029aa7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:16.506544 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aed226b6-70fb-4425-b52c-bb5d3d029aa7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:16.698023 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9ee3a9db-e4bc-48ee-9755-e4e776f97e4f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:16.701512 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-aed226b6-70fb-4425-b52c-bb5d3d029aa7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:16.706124 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9ee3a9db-e4bc-48ee-9755-e4e776f97e4f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1677 microversion: 2.1 time: 0.215333 May 17 17:14:16.707082 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 273/578] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:16 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:16.710974 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-aed226b6-70fb-4425-b52c-bb5d3d029aa7 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.217812 May 17 17:14:16.711457 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 306/579] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:16 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:17.726800 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-28c1f87c-fc36-4b95-832f-b482f7e92617 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:17.727451 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-28c1f87c-fc36-4b95-832f-b482f7e92617 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:17.728104 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2bdf451a-ee3c-494d-8bc6-04879a25cd81 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:17.728899 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2bdf451a-ee3c-494d-8bc6-04879a25cd81 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:17.733868 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-28c1f87c-fc36-4b95-832f-b482f7e92617 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:17.734318 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-28c1f87c-fc36-4b95-832f-b482f7e92617 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:17.735096 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-28c1f87c-fc36-4b95-832f-b482f7e92617 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:17.735528 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-28c1f87c-fc36-4b95-832f-b482f7e92617 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:17.736676 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2bdf451a-ee3c-494d-8bc6-04879a25cd81 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:17.737114 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2bdf451a-ee3c-494d-8bc6-04879a25cd81 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:17.738490 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2bdf451a-ee3c-494d-8bc6-04879a25cd81 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:17.739032 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2bdf451a-ee3c-494d-8bc6-04879a25cd81 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:17.924270 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-28c1f87c-fc36-4b95-832f-b482f7e92617 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:17.928192 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2bdf451a-ee3c-494d-8bc6-04879a25cd81 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:17.933292 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-28c1f87c-fc36-4b95-832f-b482f7e92617 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1677 microversion: 2.1 time: 0.210223 May 17 17:14:17.934110 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 274/580] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:17 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1677 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:17.936472 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2bdf451a-ee3c-494d-8bc6-04879a25cd81 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.212477 May 17 17:14:17.937038 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 307/581] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:17 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:18.951287 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-c19e1097-f106-4d6e-90bb-4ad3f7908bbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:18.951991 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-c19e1097-f106-4d6e-90bb-4ad3f7908bbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:18.954451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-0fa2c802-5314-4b83-975d-1f1e49989dae tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:18.955359 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-0fa2c802-5314-4b83-975d-1f1e49989dae tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:18.958222 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c19e1097-f106-4d6e-90bb-4ad3f7908bbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:18.958667 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c19e1097-f106-4d6e-90bb-4ad3f7908bbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:18.959437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c19e1097-f106-4d6e-90bb-4ad3f7908bbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:18.959888 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c19e1097-f106-4d6e-90bb-4ad3f7908bbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:18.963118 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0fa2c802-5314-4b83-975d-1f1e49989dae tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:18.963703 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0fa2c802-5314-4b83-975d-1f1e49989dae tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:18.964671 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0fa2c802-5314-4b83-975d-1f1e49989dae tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:18.965399 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0fa2c802-5314-4b83-975d-1f1e49989dae tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:19.153838 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-c19e1097-f106-4d6e-90bb-4ad3f7908bbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:19.162609 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-0fa2c802-5314-4b83-975d-1f1e49989dae tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:19.163934 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-c19e1097-f106-4d6e-90bb-4ad3f7908bbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1677 microversion: 2.1 time: 0.216372 May 17 17:14:19.164604 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 275/582] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:18 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:19.170707 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-0fa2c802-5314-4b83-975d-1f1e49989dae tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.220814 May 17 17:14:19.171416 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 308/583] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:18 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:20.181427 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4eb2689c-80ab-4db7-95a6-bbca9aff1c9c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:20.182062 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4eb2689c-80ab-4db7-95a6-bbca9aff1c9c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:20.188434 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-00d578c6-4e05-4a0a-bfef-808883696ec0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:20.188904 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4eb2689c-80ab-4db7-95a6-bbca9aff1c9c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:20.189007 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4eb2689c-80ab-4db7-95a6-bbca9aff1c9c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:20.189099 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-00d578c6-4e05-4a0a-bfef-808883696ec0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:20.189717 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4eb2689c-80ab-4db7-95a6-bbca9aff1c9c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:20.190184 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4eb2689c-80ab-4db7-95a6-bbca9aff1c9c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:20.195489 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-00d578c6-4e05-4a0a-bfef-808883696ec0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:20.195967 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-00d578c6-4e05-4a0a-bfef-808883696ec0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:20.196725 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-00d578c6-4e05-4a0a-bfef-808883696ec0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:20.197154 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-00d578c6-4e05-4a0a-bfef-808883696ec0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:20.389030 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-00d578c6-4e05-4a0a-bfef-808883696ec0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:20.396022 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4eb2689c-80ab-4db7-95a6-bbca9aff1c9c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:20.399176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-00d578c6-4e05-4a0a-bfef-808883696ec0 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.214341 May 17 17:14:20.400274 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 309/584] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:20 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:20.404746 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4eb2689c-80ab-4db7-95a6-bbca9aff1c9c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1677 microversion: 2.1 time: 0.227303 May 17 17:14:20.405359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 276/585] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:20 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:21.417662 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-23562674-4ad5-48a1-b5aa-4c2198b24228 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:21.418286 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-23562674-4ad5-48a1-b5aa-4c2198b24228 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:21.426086 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3a270355-7b59-495c-b2dd-3dece5941dfa tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:21.426591 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-23562674-4ad5-48a1-b5aa-4c2198b24228 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:21.426591 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-23562674-4ad5-48a1-b5aa-4c2198b24228 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:21.427562 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3a270355-7b59-495c-b2dd-3dece5941dfa tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:21.427872 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-23562674-4ad5-48a1-b5aa-4c2198b24228 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:21.428346 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-23562674-4ad5-48a1-b5aa-4c2198b24228 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:21.434115 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a270355-7b59-495c-b2dd-3dece5941dfa tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:21.434576 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a270355-7b59-495c-b2dd-3dece5941dfa tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:21.435357 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a270355-7b59-495c-b2dd-3dece5941dfa tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:21.435901 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a270355-7b59-495c-b2dd-3dece5941dfa tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:21.645609 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-23562674-4ad5-48a1-b5aa-4c2198b24228 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:21.649646 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3a270355-7b59-495c-b2dd-3dece5941dfa tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:21.653931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-23562674-4ad5-48a1-b5aa-4c2198b24228 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.239995 May 17 17:14:21.654595 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 310/586] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:21 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:21.657220 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3a270355-7b59-495c-b2dd-3dece5941dfa tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1677 microversion: 2.1 time: 0.236115 May 17 17:14:21.658041 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 277/587] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:21 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:22.675841 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7562b4ba-50a8-42e8-a434-e9c2b40686c0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:22.676514 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7562b4ba-50a8-42e8-a434-e9c2b40686c0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:22.677409 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-dc21e099-c8bc-4525-ba98-4521a0965c42 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:22.678363 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-dc21e099-c8bc-4525-ba98-4521a0965c42 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:22.684414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7562b4ba-50a8-42e8-a434-e9c2b40686c0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:22.684414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7562b4ba-50a8-42e8-a434-e9c2b40686c0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:22.684741 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7562b4ba-50a8-42e8-a434-e9c2b40686c0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:22.685189 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7562b4ba-50a8-42e8-a434-e9c2b40686c0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:22.688332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dc21e099-c8bc-4525-ba98-4521a0965c42 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:22.689028 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dc21e099-c8bc-4525-ba98-4521a0965c42 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:22.690249 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dc21e099-c8bc-4525-ba98-4521a0965c42 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:22.691416 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dc21e099-c8bc-4525-ba98-4521a0965c42 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:22.902724 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-dc21e099-c8bc-4525-ba98-4521a0965c42 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:22.917483 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-dc21e099-c8bc-4525-ba98-4521a0965c42 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.246042 May 17 17:14:22.918672 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 311/588] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:22 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:22.921283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7562b4ba-50a8-42e8-a434-e9c2b40686c0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:22.930071 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7562b4ba-50a8-42e8-a434-e9c2b40686c0 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1677 microversion: 2.1 time: 0.258714 May 17 17:14:22.930653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 278/589] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:22 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1677 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:23.935332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-35eb7a6f-da05-4752-9975-f82b6da61f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:23.935956 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-35eb7a6f-da05-4752-9975-f82b6da61f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:23.942652 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-35eb7a6f-da05-4752-9975-f82b6da61f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:23.943114 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-35eb7a6f-da05-4752-9975-f82b6da61f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:23.943928 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-35eb7a6f-da05-4752-9975-f82b6da61f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:23.944371 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-35eb7a6f-da05-4752-9975-f82b6da61f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:23.947499 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4382b028-7d81-496a-88d6-0b6cb1218856 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:23.948306 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4382b028-7d81-496a-88d6-0b6cb1218856 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:23.955647 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4382b028-7d81-496a-88d6-0b6cb1218856 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:23.956560 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4382b028-7d81-496a-88d6-0b6cb1218856 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:23.957340 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4382b028-7d81-496a-88d6-0b6cb1218856 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:23.957777 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4382b028-7d81-496a-88d6-0b6cb1218856 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:24.142703 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-35eb7a6f-da05-4752-9975-f82b6da61f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:24.153662 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-35eb7a6f-da05-4752-9975-f82b6da61f77 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.222209 May 17 17:14:24.164011 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 312/590] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:23 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:24.168554 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4382b028-7d81-496a-88d6-0b6cb1218856 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:24.176947 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4382b028-7d81-496a-88d6-0b6cb1218856 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1677 microversion: 2.1 time: 0.233716 May 17 17:14:24.177517 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 279/591] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:23 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:25.171674 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8fd92f04-da6a-455c-ae9b-f0a03b691e73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:25.172258 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8fd92f04-da6a-455c-ae9b-f0a03b691e73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:25.179450 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8fd92f04-da6a-455c-ae9b-f0a03b691e73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:25.180092 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8fd92f04-da6a-455c-ae9b-f0a03b691e73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:25.180930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8fd92f04-da6a-455c-ae9b-f0a03b691e73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:25.181537 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8fd92f04-da6a-455c-ae9b-f0a03b691e73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:25.198233 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8d9ce047-d26e-4b9e-ba18-6071b5f17d43 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:25.199353 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8d9ce047-d26e-4b9e-ba18-6071b5f17d43 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:25.209605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8d9ce047-d26e-4b9e-ba18-6071b5f17d43 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:25.210339 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8d9ce047-d26e-4b9e-ba18-6071b5f17d43 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:25.211621 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8d9ce047-d26e-4b9e-ba18-6071b5f17d43 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:25.212367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8d9ce047-d26e-4b9e-ba18-6071b5f17d43 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:25.401308 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8fd92f04-da6a-455c-ae9b-f0a03b691e73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:25.408913 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-8d9ce047-d26e-4b9e-ba18-6071b5f17d43 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:25.410238 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8fd92f04-da6a-455c-ae9b-f0a03b691e73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.242371 May 17 17:14:25.410830 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 313/592] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:25 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:25.418092 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8d9ce047-d26e-4b9e-ba18-6071b5f17d43 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1677 microversion: 2.1 time: 0.226807 May 17 17:14:25.418659 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 280/593] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:25 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:26.434480 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-844766e2-5f43-48b3-b218-a122ac59744f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:26.436591 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-844766e2-5f43-48b3-b218-a122ac59744f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:26.440996 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-836cf7f3-fb46-45c1-803b-d6ca8beda819 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:26.442796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-836cf7f3-fb46-45c1-803b-d6ca8beda819 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:26.447474 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-844766e2-5f43-48b3-b218-a122ac59744f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:26.450985 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-844766e2-5f43-48b3-b218-a122ac59744f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:26.452057 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-844766e2-5f43-48b3-b218-a122ac59744f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:26.452920 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-844766e2-5f43-48b3-b218-a122ac59744f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:26.458492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-836cf7f3-fb46-45c1-803b-d6ca8beda819 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:26.460275 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-836cf7f3-fb46-45c1-803b-d6ca8beda819 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:26.462901 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-836cf7f3-fb46-45c1-803b-d6ca8beda819 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:26.464575 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-836cf7f3-fb46-45c1-803b-d6ca8beda819 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:26.800079 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-836cf7f3-fb46-45c1-803b-d6ca8beda819 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:26.801720 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-844766e2-5f43-48b3-b218-a122ac59744f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:26.809473 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-844766e2-5f43-48b3-b218-a122ac59744f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1677 microversion: 2.1 time: 0.378692 May 17 17:14:26.810351 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 281/594] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:26 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1677 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:26.814167 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-836cf7f3-fb46-45c1-803b-d6ca8beda819 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.385282 May 17 17:14:26.815764 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 314/595] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:26 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:27.830438 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f792cbc6-53f9-4758-90a2-f52acfa43320 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:27.831952 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f792cbc6-53f9-4758-90a2-f52acfa43320 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:27.835260 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f17c97dc-c8cd-4c58-82f2-d56d7f2a7253 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:27.836028 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f17c97dc-c8cd-4c58-82f2-d56d7f2a7253 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:27.838466 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f792cbc6-53f9-4758-90a2-f52acfa43320 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:27.838931 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f792cbc6-53f9-4758-90a2-f52acfa43320 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:27.839752 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f792cbc6-53f9-4758-90a2-f52acfa43320 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:27.840197 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f792cbc6-53f9-4758-90a2-f52acfa43320 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:27.843281 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f17c97dc-c8cd-4c58-82f2-d56d7f2a7253 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:27.843897 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f17c97dc-c8cd-4c58-82f2-d56d7f2a7253 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:27.844792 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f17c97dc-c8cd-4c58-82f2-d56d7f2a7253 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:27.845331 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f17c97dc-c8cd-4c58-82f2-d56d7f2a7253 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:28.106064 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f17c97dc-c8cd-4c58-82f2-d56d7f2a7253 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:28.115177 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f17c97dc-c8cd-4c58-82f2-d56d7f2a7253 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1735 microversion: 2.1 time: 0.286050 May 17 17:14:28.115993 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 315/596] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:27 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:28.118781 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f792cbc6-53f9-4758-90a2-f52acfa43320 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:28.126194 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f792cbc6-53f9-4758-90a2-f52acfa43320 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1654 microversion: 2.1 time: 0.301330 May 17 17:14:28.126765 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 282/597] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:27 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1654 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:28.144295 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2c51bdd9-9a8e-4d0d-9018-0489c1a2d52c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:28.152683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2c51bdd9-9a8e-4d0d-9018-0489c1a2d52c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:28.153121 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2c51bdd9-9a8e-4d0d-9018-0489c1a2d52c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:28.228418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2c51bdd9-9a8e-4d0d-9018-0489c1a2d52c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Going to try to start instance {{(pid=117090) start /opt/stack/nova/nova/compute/api.py:2730}} May 17 17:14:28.278648 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2c51bdd9-9a8e-4d0d-9018-0489c1a2d52c tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "POST /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/action" status: 202 len: 0 microversion: 2.1 time: 0.139013 May 17 17:14:28.279320 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 316/598] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 17 17:14:28 2022] POST /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:14:28.289432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-097461c1-17bb-43d4-9995-c61a4336e4da tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:28.290122 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-097461c1-17bb-43d4-9995-c61a4336e4da tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:28.296663 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-097461c1-17bb-43d4-9995-c61a4336e4da tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:28.297125 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-097461c1-17bb-43d4-9995-c61a4336e4da tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:28.297923 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-097461c1-17bb-43d4-9995-c61a4336e4da tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:28.298369 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-097461c1-17bb-43d4-9995-c61a4336e4da tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:28.530826 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-097461c1-17bb-43d4-9995-c61a4336e4da tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:28.542284 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-097461c1-17bb-43d4-9995-c61a4336e4da tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1663 microversion: 2.1 time: 0.257017 May 17 17:14:28.543151 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 283/599] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:28 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1663 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:29.139109 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d84aa2a0-4339-4bca-b4e7-060a1f2cc8fe tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:29.139987 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d84aa2a0-4339-4bca-b4e7-060a1f2cc8fe tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:29.148322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d84aa2a0-4339-4bca-b4e7-060a1f2cc8fe tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:29.149593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d84aa2a0-4339-4bca-b4e7-060a1f2cc8fe tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:29.150633 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d84aa2a0-4339-4bca-b4e7-060a1f2cc8fe tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:29.151296 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d84aa2a0-4339-4bca-b4e7-060a1f2cc8fe tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:29.450373 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d84aa2a0-4339-4bca-b4e7-060a1f2cc8fe tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:29.460382 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d84aa2a0-4339-4bca-b4e7-060a1f2cc8fe tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1715 microversion: 2.1 time: 0.325584 May 17 17:14:29.475633 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 317/600] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:29 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1715 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:29.566340 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f789c58f-0198-48c1-9d19-d6ae71e7ccac tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:29.569307 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f789c58f-0198-48c1-9d19-d6ae71e7ccac tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:29.584448 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-6318e98d-70f7-462e-b61a-c60d8c563d6f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:29.585334 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-6318e98d-70f7-462e-b61a-c60d8c563d6f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:29.586381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f789c58f-0198-48c1-9d19-d6ae71e7ccac tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:29.587426 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f789c58f-0198-48c1-9d19-d6ae71e7ccac tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:29.589144 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f789c58f-0198-48c1-9d19-d6ae71e7ccac tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:29.590215 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f789c58f-0198-48c1-9d19-d6ae71e7ccac tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:29.599650 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6318e98d-70f7-462e-b61a-c60d8c563d6f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:29.599650 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6318e98d-70f7-462e-b61a-c60d8c563d6f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:29.602072 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6318e98d-70f7-462e-b61a-c60d8c563d6f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:29.603687 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6318e98d-70f7-462e-b61a-c60d8c563d6f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:29.756918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-6318e98d-70f7-462e-b61a-c60d8c563d6f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] HTTP exception thrown: Cannot 'detach_volume' instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 while it is in vm_state rescued May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-6318e98d-70f7-462e-b61a-c60d8c563d6f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Request method failure captured: May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: DELETE /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-volume_attachments/b4830ef3-1ab3-4c9c-958c-d8b1178888ff HTTP/1.1 May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9cIPlWrQVek_vO5Ab0bf4nYehP1BOWbMBXN-eF9jKvTtM2GSDDAPWJwb8WErqNIdz21bajaEg0P-_qRMTFIo8qTg4RCl1kwggv7oxyH9A5chbw_cqFQQScvlEt6ZZFtWpTXePcbpGZ2EJTY3cBM3VYORCJtl3kWRUuCWHEpw7EGcl4 May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: ea3305a913c541e4a45267497213df1c May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:14:29.759451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:14:29.761123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea3305a913c541e4a45267497213df1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea3305a913c541e4a45267497213df1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea3305a913c541e4a45267497213df1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea3305a913c541e4a45267497213df1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:14:29.761123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:14:29.761123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: ea3305a913c541e4a45267497213df1c May 17 17:14:29.761123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:14:29.761123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-ServerRescueNegativeTestJSON-1349300293-project May 17 17:14:29.761123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:14:29.761123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:14:29.761123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 824915e26a724d938e5dd0a3c1f57932 May 17 17:14:29.761123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349300293-project May 17 17:14:29.761123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:14:29.761123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Cannot 'detach_volume' instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 while it is in vm_state rescued May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'server_id': '5bfa0b8b-6981-43aa-9f5c-214bc3c20d64', 'id': 'b4830ef3-1ab3-4c9c-958c-d8b1178888ff'} May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:14:29.761955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 while it is in vm_state rescued May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 while it is in vm_state rescued May 17 17:14:29.763455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:14:29.766034 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-6318e98d-70f7-462e-b61a-c60d8c563d6f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Returning 409 to user: Cannot 'detach_volume' instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 while it is in vm_state rescued {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:14:29.767445 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-6318e98d-70f7-462e-b61a-c60d8c563d6f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-volume_attachments/b4830ef3-1ab3-4c9c-958c-d8b1178888ff" status: 409 len: 152 microversion: 2.1 time: 0.188876 May 17 17:14:29.772288 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 318/601] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 17 17:14:29 2022] DELETE /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-volume_attachments/b4830ef3-1ab3-4c9c-958c-d8b1178888ff => generated 152 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 17 17:14:29.778916 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b0601ebe-a09a-485d-b29b-f8331487cbdc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:29.779866 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b0601ebe-a09a-485d-b29b-f8331487cbdc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:29.790146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b0601ebe-a09a-485d-b29b-f8331487cbdc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:29.790907 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b0601ebe-a09a-485d-b29b-f8331487cbdc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:29.791955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b0601ebe-a09a-485d-b29b-f8331487cbdc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:29.792575 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b0601ebe-a09a-485d-b29b-f8331487cbdc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:29.895091 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b0601ebe-a09a-485d-b29b-f8331487cbdc tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "POST /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/action" status: 202 len: 0 microversion: 2.1 time: 0.121021 May 17 17:14:29.896253 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 319/602] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 17 17:14:29 2022] POST /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:14:29.906292 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-0d50f15e-ecb1-4aa7-a29d-90dbd1c0d706 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:29.907738 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-0d50f15e-ecb1-4aa7-a29d-90dbd1c0d706 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:29.915136 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0d50f15e-ecb1-4aa7-a29d-90dbd1c0d706 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:29.915943 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0d50f15e-ecb1-4aa7-a29d-90dbd1c0d706 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:29.917012 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0d50f15e-ecb1-4aa7-a29d-90dbd1c0d706 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:29.917756 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0d50f15e-ecb1-4aa7-a29d-90dbd1c0d706 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:30.153290 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f789c58f-0198-48c1-9d19-d6ae71e7ccac tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:30.171506 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f789c58f-0198-48c1-9d19-d6ae71e7ccac tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1663 microversion: 2.1 time: 0.612306 May 17 17:14:30.171506 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 284/603] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:29 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1663 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:30.274050 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-0d50f15e-ecb1-4aa7-a29d-90dbd1c0d706 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:30.291707 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-0d50f15e-ecb1-4aa7-a29d-90dbd1c0d706 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1723 microversion: 2.1 time: 0.390452 May 17 17:14:30.293670 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 320/604] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:29 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1723 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:31.191199 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-aeeb2dee-4c07-4c0c-afde-4434d205a133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:31.192674 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-aeeb2dee-4c07-4c0c-afde-4434d205a133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:31.199827 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-aeeb2dee-4c07-4c0c-afde-4434d205a133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:31.200667 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-aeeb2dee-4c07-4c0c-afde-4434d205a133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:31.201720 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-aeeb2dee-4c07-4c0c-afde-4434d205a133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:31.202380 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-aeeb2dee-4c07-4c0c-afde-4434d205a133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:31.312107 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c121e949-3e17-40c1-b614-bf1e1ee40961 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:31.317426 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c121e949-3e17-40c1-b614-bf1e1ee40961 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:31.339319 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c121e949-3e17-40c1-b614-bf1e1ee40961 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:31.340099 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c121e949-3e17-40c1-b614-bf1e1ee40961 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:31.343077 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c121e949-3e17-40c1-b614-bf1e1ee40961 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:31.344240 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c121e949-3e17-40c1-b614-bf1e1ee40961 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:31.512379 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-aeeb2dee-4c07-4c0c-afde-4434d205a133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:31.527991 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-aeeb2dee-4c07-4c0c-afde-4434d205a133 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1663 microversion: 2.1 time: 0.342912 May 17 17:14:31.528905 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 285/605] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:31 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1663 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:31.584103 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c121e949-3e17-40c1-b614-bf1e1ee40961 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:31.594592 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c121e949-3e17-40c1-b614-bf1e1ee40961 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1723 microversion: 2.1 time: 0.287297 May 17 17:14:31.597154 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 321/606] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:31 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:32.547645 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7ce4e03f-d6a8-4763-8ed4-eadeb3aecb57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:32.549025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7ce4e03f-d6a8-4763-8ed4-eadeb3aecb57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:32.559826 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7ce4e03f-d6a8-4763-8ed4-eadeb3aecb57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:32.560681 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7ce4e03f-d6a8-4763-8ed4-eadeb3aecb57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:32.561560 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7ce4e03f-d6a8-4763-8ed4-eadeb3aecb57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:32.562296 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7ce4e03f-d6a8-4763-8ed4-eadeb3aecb57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:32.613748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-71a0cb9d-d766-4536-ab33-af54a6366c1c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:32.615015 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-71a0cb9d-d766-4536-ab33-af54a6366c1c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:32.622017 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-71a0cb9d-d766-4536-ab33-af54a6366c1c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:32.622477 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-71a0cb9d-d766-4536-ab33-af54a6366c1c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:32.623459 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-71a0cb9d-d766-4536-ab33-af54a6366c1c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:32.623931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-71a0cb9d-d766-4536-ab33-af54a6366c1c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:32.817659 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7ce4e03f-d6a8-4763-8ed4-eadeb3aecb57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:32.834893 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7ce4e03f-d6a8-4763-8ed4-eadeb3aecb57 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1667 microversion: 2.1 time: 0.292148 May 17 17:14:32.835500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 286/607] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:32 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1667 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:32.857281 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-71a0cb9d-d766-4536-ab33-af54a6366c1c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:32.866555 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-71a0cb9d-d766-4536-ab33-af54a6366c1c tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1723 microversion: 2.1 time: 0.257580 May 17 17:14:32.867296 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 322/608] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:32 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:33.884066 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-dbfe54fd-f50b-44d2-81a0-479ececcf065 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:33.884615 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-dbfe54fd-f50b-44d2-81a0-479ececcf065 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:33.892054 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dbfe54fd-f50b-44d2-81a0-479ececcf065 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:33.892567 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dbfe54fd-f50b-44d2-81a0-479ececcf065 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:33.893393 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dbfe54fd-f50b-44d2-81a0-479ececcf065 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:33.893950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dbfe54fd-f50b-44d2-81a0-479ececcf065 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:34.089574 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-dbfe54fd-f50b-44d2-81a0-479ececcf065 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:34.100320 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-dbfe54fd-f50b-44d2-81a0-479ececcf065 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1723 microversion: 2.1 time: 0.220450 May 17 17:14:34.105794 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 287/609] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:33 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:35.117504 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-cc4686b7-dcf3-4cef-a666-b7157f5b0b76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:35.118116 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-cc4686b7-dcf3-4cef-a666-b7157f5b0b76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:35.124760 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-cc4686b7-dcf3-4cef-a666-b7157f5b0b76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:35.125218 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-cc4686b7-dcf3-4cef-a666-b7157f5b0b76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:35.125994 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-cc4686b7-dcf3-4cef-a666-b7157f5b0b76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:35.126439 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-cc4686b7-dcf3-4cef-a666-b7157f5b0b76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:35.289521 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-cc4686b7-dcf3-4cef-a666-b7157f5b0b76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:35.300195 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-cc4686b7-dcf3-4cef-a666-b7157f5b0b76 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1729 microversion: 2.1 time: 0.185673 May 17 17:14:35.300973 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 323/610] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:35 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:35.318004 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-643c3117-4427-4953-89e4-9dc749a9eb6b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:35.322095 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-643c3117-4427-4953-89e4-9dc749a9eb6b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:35.329667 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-643c3117-4427-4953-89e4-9dc749a9eb6b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:35.330681 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-643c3117-4427-4953-89e4-9dc749a9eb6b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:35.331571 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-643c3117-4427-4953-89e4-9dc749a9eb6b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:35.332798 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-643c3117-4427-4953-89e4-9dc749a9eb6b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:35.418793 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-643c3117-4427-4953-89e4-9dc749a9eb6b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105651 May 17 17:14:35.419393 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 288/611] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 17 17:14:35 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:14:36.885200 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-6574f308-95cc-4fb9-8831-95e540d4797d req-ddded00f-cad0-4672-96f8-fc0d24d48d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfa0b8b-6981-43aa-9f5c-214bc3c20d64", "tag": "6b3cb952-d5bd-4de9-965c-39fcdbf9ab21"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:36.896113 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-6574f308-95cc-4fb9-8831-95e540d4797d req-ddded00f-cad0-4672-96f8-fc0d24d48d08 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:36.904365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-6574f308-95cc-4fb9-8831-95e540d4797d req-ddded00f-cad0-4672-96f8-fc0d24d48d08 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:36.927091 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-6574f308-95cc-4fb9-8831-95e540d4797d req-ddded00f-cad0-4672-96f8-fc0d24d48d08 service nova] Creating event network-changed:6b3cb952-d5bd-4de9-965c-39fcdbf9ab21 for instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 on hv-cinder-84214 May 17 17:14:36.950095 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-6574f308-95cc-4fb9-8831-95e540d4797d req-ddded00f-cad0-4672-96f8-fc0d24d48d08 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067630 May 17 17:14:36.953804 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 324/612] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:39.021165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-8fd40196-7df9-4271-86d3-b70f26811376 req-2ca3cf2e-c11b-40b9-b34f-57c939cfa1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfa0b8b-6981-43aa-9f5c-214bc3c20d64", "tag": "6b3cb952-d5bd-4de9-965c-39fcdbf9ab21"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:39.031573 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-8fd40196-7df9-4271-86d3-b70f26811376 req-2ca3cf2e-c11b-40b9-b34f-57c939cfa1d3 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:39.032359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-8fd40196-7df9-4271-86d3-b70f26811376 req-2ca3cf2e-c11b-40b9-b34f-57c939cfa1d3 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:39.059951 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-8fd40196-7df9-4271-86d3-b70f26811376 req-2ca3cf2e-c11b-40b9-b34f-57c939cfa1d3 service nova] Creating event network-changed:6b3cb952-d5bd-4de9-965c-39fcdbf9ab21 for instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 on hv-cinder-84214 May 17 17:14:39.101023 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-8fd40196-7df9-4271-86d3-b70f26811376 req-2ca3cf2e-c11b-40b9-b34f-57c939cfa1d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068783 May 17 17:14:39.102044 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 289/613] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:14:39.577428 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-134df55d-4585-4a9d-89ff-731f3b3c98c0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Action: 'create', calling method: .version_select at 0x7feb12fa4ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-402373830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf8nPxYq2EApscQmsAMIhzkFX4W1c7zQsHpHAznIDacOLRbQGx66nibQfU0CKcI/f76CPj1V3xGZixOpKmKEZ+OOBLBOwG31jUeBp9ytBm63vf4YPpfajV/hT2T7uEQEA=="}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:39.592725 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-134df55d-4585-4a9d-89ff-731f3b3c98c0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Getting quotas for project b1528992e3c74c08b5c4192466f23852. Resources: {'key_pairs'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:14:39.602478 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-134df55d-4585-4a9d-89ff-731f3b3c98c0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Getting quotas for user 38bdb5f8e08e49358f9f27e4f1ce167b and project b1528992e3c74c08b5c4192466f23852. Resources: {'key_pairs'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:14:39.630207 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-134df55d-4585-4a9d-89ff-731f3b3c98c0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.263139 May 17 17:14:39.635657 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 325/614] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 17 17:14:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:42.052597 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-03b9bc92-0e45-450f-ab36-95da41342152 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:42.053192 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-03b9bc92-0e45-450f-ab36-95da41342152 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:42.066136 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-03b9bc92-0e45-450f-ab36-95da41342152 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:42.066786 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-03b9bc92-0e45-450f-ab36-95da41342152 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:42.067686 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-03b9bc92-0e45-450f-ab36-95da41342152 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:42.068307 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-03b9bc92-0e45-450f-ab36-95da41342152 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:42.100736 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-03b9bc92-0e45-450f-ab36-95da41342152 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/os-volume_attachments/03736da3-e5c7-44f1-9aee-dc158ed7abe7" status: 200 len: 194 microversion: 2.20 time: 0.054022 May 17 17:14:42.101417 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 290/615] 10.222.0.48 () {60 vars in 1453 bytes} [Tue May 17 17:14:42 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/os-volume_attachments/03736da3-e5c7-44f1-9aee-dc158ed7abe7 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:14:42.168711 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b96145dd-6d56-4492-a815-289e2f50c5d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:42.169342 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b96145dd-6d56-4492-a815-289e2f50c5d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:42.176941 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b96145dd-6d56-4492-a815-289e2f50c5d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:42.177418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b96145dd-6d56-4492-a815-289e2f50c5d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:42.178203 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b96145dd-6d56-4492-a815-289e2f50c5d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:42.178673 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b96145dd-6d56-4492-a815-289e2f50c5d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:42.264475 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-b96145dd-6d56-4492-a815-289e2f50c5d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lazy-loading 'services' on Instance uuid b074c961-149b-4667-addc-790568769b88 {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:14:42.343114 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b96145dd-6d56-4492-a815-289e2f50c5d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/os-volume_attachments/03736da3-e5c7-44f1-9aee-dc158ed7abe7" status: 202 len: 0 microversion: 2.20 time: 0.178820 May 17 17:14:42.343900 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 326/616] 10.222.0.48 () {60 vars in 1456 bytes} [Tue May 17 17:14:42 2022] DELETE /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/os-volume_attachments/03736da3-e5c7-44f1-9aee-dc158ed7abe7 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 17:14:42.354088 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ea3d87ea-75e9-49f8-93a1-caebaefbf642 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:42.355106 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ea3d87ea-75e9-49f8-93a1-caebaefbf642 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:42.362232 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ea3d87ea-75e9-49f8-93a1-caebaefbf642 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:42.362802 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ea3d87ea-75e9-49f8-93a1-caebaefbf642 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:42.363593 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ea3d87ea-75e9-49f8-93a1-caebaefbf642 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:42.364249 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ea3d87ea-75e9-49f8-93a1-caebaefbf642 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:42.400289 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ea3d87ea-75e9-49f8-93a1-caebaefbf642 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050323 May 17 17:14:42.401144 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 291/617] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 17 17:14:42 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:14:43.415214 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2c3f7c8f-e5fa-466a-bd41-5a2af8c2e73e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:43.416155 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2c3f7c8f-e5fa-466a-bd41-5a2af8c2e73e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:43.422328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2c3f7c8f-e5fa-466a-bd41-5a2af8c2e73e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:43.422771 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2c3f7c8f-e5fa-466a-bd41-5a2af8c2e73e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:43.423529 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2c3f7c8f-e5fa-466a-bd41-5a2af8c2e73e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:43.423987 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2c3f7c8f-e5fa-466a-bd41-5a2af8c2e73e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:43.453859 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2c3f7c8f-e5fa-466a-bd41-5a2af8c2e73e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044029 May 17 17:14:43.454416 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 327/618] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 17 17:14:43 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:43.514689 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-96dc37ab-f5aa-4d9e-a123-728ffa1df00b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:43.515211 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-96dc37ab-f5aa-4d9e-a123-728ffa1df00b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:43.522223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-96dc37ab-f5aa-4d9e-a123-728ffa1df00b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:43.522753 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-96dc37ab-f5aa-4d9e-a123-728ffa1df00b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:43.523536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-96dc37ab-f5aa-4d9e-a123-728ffa1df00b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:43.523981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-96dc37ab-f5aa-4d9e-a123-728ffa1df00b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:43.548944 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-96dc37ab-f5aa-4d9e-a123-728ffa1df00b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Going to try to terminate instance {{(pid=117089) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:14:43.625362 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-96dc37ab-f5aa-4d9e-a123-728ffa1df00b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 204 len: 0 microversion: 2.20 time: 0.114265 May 17 17:14:43.626025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 292/619] 10.222.0.48 () {60 vars in 1279 bytes} [Tue May 17 17:14:43 2022] DELETE /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 17:14:43.635037 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1f85544d-52ac-4668-9aae-4b3f1e3f8150 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:43.635676 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1f85544d-52ac-4668-9aae-4b3f1e3f8150 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:43.641898 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f85544d-52ac-4668-9aae-4b3f1e3f8150 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:43.643123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f85544d-52ac-4668-9aae-4b3f1e3f8150 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:43.643925 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f85544d-52ac-4668-9aae-4b3f1e3f8150 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:43.644360 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f85544d-52ac-4668-9aae-4b3f1e3f8150 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:43.777655 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1f85544d-52ac-4668-9aae-4b3f1e3f8150 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:43.786541 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1f85544d-52ac-4668-9aae-4b3f1e3f8150 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:43.788074 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1f85544d-52ac-4668-9aae-4b3f1e3f8150 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:43.789260 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1f85544d-52ac-4668-9aae-4b3f1e3f8150 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.158224 May 17 17:14:43.789825 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 328/620] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:14:43 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:14:44.809246 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-99a6551d-d91a-47ca-9b87-a6d4ed175a56 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:44.809980 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-99a6551d-d91a-47ca-9b87-a6d4ed175a56 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:44.816703 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-99a6551d-d91a-47ca-9b87-a6d4ed175a56 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:44.817202 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-99a6551d-d91a-47ca-9b87-a6d4ed175a56 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:44.818282 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-99a6551d-d91a-47ca-9b87-a6d4ed175a56 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:44.818732 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-99a6551d-d91a-47ca-9b87-a6d4ed175a56 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:44.954158 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-99a6551d-d91a-47ca-9b87-a6d4ed175a56 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:44.962641 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-99a6551d-d91a-47ca-9b87-a6d4ed175a56 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:44.964157 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-99a6551d-d91a-47ca-9b87-a6d4ed175a56 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:44.965307 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-99a6551d-d91a-47ca-9b87-a6d4ed175a56 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.160357 May 17 17:14:44.965857 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 293/621] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:14:44 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:14:45.240323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-59f1104a-e048-48f8-a22c-fc1faa563371 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:45.240846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-59f1104a-e048-48f8-a22c-fc1faa563371 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:45.247336 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-59f1104a-e048-48f8-a22c-fc1faa563371 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:45.247828 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-59f1104a-e048-48f8-a22c-fc1faa563371 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:45.248596 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-59f1104a-e048-48f8-a22c-fc1faa563371 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:45.249031 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-59f1104a-e048-48f8-a22c-fc1faa563371 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:45.273024 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-59f1104a-e048-48f8-a22c-fc1faa563371 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2/ips" status: 200 len: 151 microversion: 2.1 time: 0.036557 May 17 17:14:45.273590 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 329/622] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 17 17:14:45 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:45.284707 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e48937a0-cf89-4138-bfc3-68aedcac4dd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "548d5cdb-63b3-48e0-9170-ea0334b16444"}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:45.285971 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e48937a0-cf89-4138-bfc3-68aedcac4dd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:45.292035 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e48937a0-cf89-4138-bfc3-68aedcac4dd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:45.292438 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e48937a0-cf89-4138-bfc3-68aedcac4dd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:45.293206 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e48937a0-cf89-4138-bfc3-68aedcac4dd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:45.293640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e48937a0-cf89-4138-bfc3-68aedcac4dd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:45.371919 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-e48937a0-cf89-4138-bfc3-68aedcac4dd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] HTTP exception thrown: Invalid volume: volume 548d5cdb-63b3-48e0-9170-ea0334b16444 is already attached to instances: 0a762b56-1a2c-4556-90cb-52de211c17a5 May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e48937a0-cf89-4138-bfc3-68aedcac4dd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Request method failure captured: May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: POST /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2/os-volume_attachments HTTP/1.1 May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 74 May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9dPWJVb7qwYBnOyu2SibnIHb7br9I07PYlwLrrT_SRrqmmG-Yk2L4b9g7-opL8KlEa-VvVIvtF7WR6pTkYQoWCb_iUMaherr4GYvkZBEx7i_4xoMizUYe3fXvOKjqnKrfi4cSl1B6_TYNoX5UI1IzkedqJD3SKAMFqJ-H9rW400QlM May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:14:45.373688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:14:45.375195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:14:45.375195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:14:45.375195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:14:45.375195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:14:45.375195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:14:45.375195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:14:45.375195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:14:45.375195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 61daaf70d25c4e1592fcb2f4feafff86 May 17 17:14:45.375195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:14:45.375195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: May 17 17:14:45.375195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {"volumeAttachment": {"volumeId": "548d5cdb-63b3-48e0-9170-ea0334b16444"}} May 17 17:14:45.375195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Invalid volume: volume 548d5cdb-63b3-48e0-9170-ea0334b16444 is already attached to instances: 0a762b56-1a2c-4556-90cb-52de211c17a5 May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'server_id': 'cb476330-5832-4b1c-bc73-9e902cbb77b2', 'body': {'volumeAttachment': {'volumeId': '548d5cdb-63b3-48e0-9170-ea0334b16444'}}} May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 548d5cdb-63b3-48e0-9170-ea0334b16444 is already attached to instances: 0a762b56-1a2c-4556-90cb-52de211c17a5 May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:45.376127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 548d5cdb-63b3-48e0-9170-ea0334b16444 is already attached to instances: 0a762b56-1a2c-4556-90cb-52de211c17a5 May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:45.378141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:14:45.379674 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:14:45.379674 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:14:45.379674 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:14:45.379674 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 548d5cdb-63b3-48e0-9170-ea0334b16444 is already attached to instances: 0a762b56-1a2c-4556-90cb-52de211c17a5 May 17 17:14:45.379674 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:45.379674 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e48937a0-cf89-4138-bfc3-68aedcac4dd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Returning 400 to user: Invalid volume: volume 548d5cdb-63b3-48e0-9170-ea0334b16444 is already attached to instances: 0a762b56-1a2c-4556-90cb-52de211c17a5 {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:14:45.379674 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e48937a0-cf89-4138-bfc3-68aedcac4dd9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "POST /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094894 May 17 17:14:45.379674 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 294/623] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 17 17:14:45 2022] POST /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 17:14:45.384368 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-863142da-9f71-48c4-b4d2-15ce88070da2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:45.384862 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-863142da-9f71-48c4-b4d2-15ce88070da2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:45.390829 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-863142da-9f71-48c4-b4d2-15ce88070da2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:45.391272 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-863142da-9f71-48c4-b4d2-15ce88070da2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:45.392140 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-863142da-9f71-48c4-b4d2-15ce88070da2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:45.392566 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-863142da-9f71-48c4-b4d2-15ce88070da2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:45.417306 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-863142da-9f71-48c4-b4d2-15ce88070da2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Going to try to terminate instance {{(pid=117090) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:14:45.497366 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-863142da-9f71-48c4-b4d2-15ce88070da2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 204 len: 0 microversion: 2.1 time: 0.116480 May 17 17:14:45.497946 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 330/624] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:14:45 2022] DELETE /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:14:45.508945 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-dabd7913-9977-44c6-9b37-b3692c9254a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:45.508945 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-dabd7913-9977-44c6-9b37-b3692c9254a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:45.520381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dabd7913-9977-44c6-9b37-b3692c9254a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:45.520834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dabd7913-9977-44c6-9b37-b3692c9254a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:45.521612 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dabd7913-9977-44c6-9b37-b3692c9254a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:45.522081 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dabd7913-9977-44c6-9b37-b3692c9254a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:45.653084 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-dabd7913-9977-44c6-9b37-b3692c9254a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:45.661255 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-dabd7913-9977-44c6-9b37-b3692c9254a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1683 microversion: 2.1 time: 0.158718 May 17 17:14:45.661816 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 295/625] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:45 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:45.984095 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8ceb8378-13ed-4e13-8760-e60850b57788 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:45.984706 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8ceb8378-13ed-4e13-8760-e60850b57788 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:45.991314 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8ceb8378-13ed-4e13-8760-e60850b57788 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:45.991810 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8ceb8378-13ed-4e13-8760-e60850b57788 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:45.992577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8ceb8378-13ed-4e13-8760-e60850b57788 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:45.993016 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8ceb8378-13ed-4e13-8760-e60850b57788 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:46.128645 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8ceb8378-13ed-4e13-8760-e60850b57788 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:46.137509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8ceb8378-13ed-4e13-8760-e60850b57788 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:46.139019 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8ceb8378-13ed-4e13-8760-e60850b57788 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:46.140239 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8ceb8378-13ed-4e13-8760-e60850b57788 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.160624 May 17 17:14:46.140801 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 331/626] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:14:45 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:14:46.678513 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ab5517bc-f0a6-4b48-a549-90d85471030a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:46.679118 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ab5517bc-f0a6-4b48-a549-90d85471030a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:46.685633 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ab5517bc-f0a6-4b48-a549-90d85471030a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:46.686073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ab5517bc-f0a6-4b48-a549-90d85471030a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:46.686841 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ab5517bc-f0a6-4b48-a549-90d85471030a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:46.687281 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ab5517bc-f0a6-4b48-a549-90d85471030a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:46.827315 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ab5517bc-f0a6-4b48-a549-90d85471030a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:46.834832 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ab5517bc-f0a6-4b48-a549-90d85471030a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1683 microversion: 2.1 time: 0.160128 May 17 17:14:46.835402 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 296/627] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:46 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:47.159621 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f3b2a87c-d1b7-49c4-a3b0-6ac79790f447 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:47.160395 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f3b2a87c-d1b7-49c4-a3b0-6ac79790f447 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:47.166914 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3b2a87c-d1b7-49c4-a3b0-6ac79790f447 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:47.167360 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3b2a87c-d1b7-49c4-a3b0-6ac79790f447 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:47.168160 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3b2a87c-d1b7-49c4-a3b0-6ac79790f447 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:47.168593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f3b2a87c-d1b7-49c4-a3b0-6ac79790f447 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:47.309630 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f3b2a87c-d1b7-49c4-a3b0-6ac79790f447 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:47.317876 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f3b2a87c-d1b7-49c4-a3b0-6ac79790f447 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:47.319522 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f3b2a87c-d1b7-49c4-a3b0-6ac79790f447 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:47.320882 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f3b2a87c-d1b7-49c4-a3b0-6ac79790f447 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1724 microversion: 2.20 time: 0.166317 May 17 17:14:47.321523 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 332/628] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:14:47 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:14:47.852998 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-48056793-b604-48c0-b333-61d6406da039 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:47.853735 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-48056793-b604-48c0-b333-61d6406da039 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:47.860242 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-48056793-b604-48c0-b333-61d6406da039 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:47.861753 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-48056793-b604-48c0-b333-61d6406da039 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:47.862218 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-48056793-b604-48c0-b333-61d6406da039 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:47.862948 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-48056793-b604-48c0-b333-61d6406da039 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:48.006339 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-48056793-b604-48c0-b333-61d6406da039 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:48.014310 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-48056793-b604-48c0-b333-61d6406da039 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1683 microversion: 2.1 time: 0.165203 May 17 17:14:48.015652 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 297/629] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:47 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:48.279958 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-c4924170-c7d7-480f-9fee-7418f3a8423c req-d2415967-8d57-4a6a-afb4-58de95934ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b074c961-149b-4667-addc-790568769b88", "name": "network-vif-deleted", "tag": "e6735ae1-4241-48ca-9802-22aba7b4cccc"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:48.291014 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-c4924170-c7d7-480f-9fee-7418f3a8423c req-d2415967-8d57-4a6a-afb4-58de95934ecb service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:48.291868 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-c4924170-c7d7-480f-9fee-7418f3a8423c req-d2415967-8d57-4a6a-afb4-58de95934ecb service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:48.305905 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-c4924170-c7d7-480f-9fee-7418f3a8423c req-d2415967-8d57-4a6a-afb4-58de95934ecb service nova] Creating event network-vif-deleted:e6735ae1-4241-48ca-9802-22aba7b4cccc for instance b074c961-149b-4667-addc-790568769b88 on hv-cinder-84214 May 17 17:14:48.317019 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-c4924170-c7d7-480f-9fee-7418f3a8423c req-d2415967-8d57-4a6a-afb4-58de95934ecb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040700 May 17 17:14:48.318324 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 333/630] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:48.340806 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f68514aa-7397-4c98-8160-853ea00a7763 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:48.341851 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f68514aa-7397-4c98-8160-853ea00a7763 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:48.353650 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f68514aa-7397-4c98-8160-853ea00a7763 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:48.354508 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f68514aa-7397-4c98-8160-853ea00a7763 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:48.356288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f68514aa-7397-4c98-8160-853ea00a7763 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:48.357739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f68514aa-7397-4c98-8160-853ea00a7763 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:48.468537 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f68514aa-7397-4c98-8160-853ea00a7763 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:48.479365 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f68514aa-7397-4c98-8160-853ea00a7763 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:48.481599 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f68514aa-7397-4c98-8160-853ea00a7763 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:48.482781 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f68514aa-7397-4c98-8160-853ea00a7763 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 200 len: 1367 microversion: 2.20 time: 0.146619 May 17 17:14:48.483565 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 298/631] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:14:48 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:14:49.034750 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-993a12f1-2dba-49df-868f-172efcd51ac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:49.035935 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-993a12f1-2dba-49df-868f-172efcd51ac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:49.045738 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-993a12f1-2dba-49df-868f-172efcd51ac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:49.047179 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-993a12f1-2dba-49df-868f-172efcd51ac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:49.048918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-993a12f1-2dba-49df-868f-172efcd51ac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:49.049808 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-993a12f1-2dba-49df-868f-172efcd51ac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:49.090819 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-993a12f1-2dba-49df-868f-172efcd51ac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:49.091667 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-993a12f1-2dba-49df-868f-172efcd51ac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:49.095843 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-993a12f1-2dba-49df-868f-172efcd51ac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lazy-loading 'fault' on Instance uuid cb476330-5832-4b1c-bc73-9e902cbb77b2 {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:14:49.151330 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-993a12f1-2dba-49df-868f-172efcd51ac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:49.160942 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-993a12f1-2dba-49df-868f-172efcd51ac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 200 len: 1331 microversion: 2.1 time: 0.131741 May 17 17:14:49.170948 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 334/632] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:49 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 1331 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:49.504125 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1db2a240-603d-49d8-bb59-a869e9307435 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:49.505382 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1db2a240-603d-49d8-bb59-a869e9307435 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:49.513518 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1db2a240-603d-49d8-bb59-a869e9307435 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:49.514324 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1db2a240-603d-49d8-bb59-a869e9307435 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:49.515298 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1db2a240-603d-49d8-bb59-a869e9307435 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:49.515979 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1db2a240-603d-49d8-bb59-a869e9307435 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:49.544757 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-1db2a240-603d-49d8-bb59-a869e9307435 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] HTTP exception thrown: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1db2a240-603d-49d8-bb59-a869e9307435 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Request method failure captured: May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 HTTP/1.1 May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9cGE5WwJ43H7c_jXMGhJwcMbrd3z2NY1pr03NfBNQtU1euQDxsTIEhWqMMVkzERF7Elr4_qRg9ROaXHF3Pel6Jv0boZYZaXVj_GbSpJlSTAM80tyqrlX3r9a2AmsKSuKxSITU8QmnJxzKhawMrmD-LwE6JBOutaQJxU6fBEvGobAW8 May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Openstack-Nova-Api-Version: 2.20 May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 9d587d1ef11b4055b77055e6fbcc1899 May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:14:49.546605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:14:49.548695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:14:49.548695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:14:49.548695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 9d587d1ef11b4055b77055e6fbcc1899 May 17 17:14:49.548695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:14:49.548695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-AttachVolumeShelveTestJSON-1404132781-project May 17 17:14:49.548695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:14:49.548695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:14:49.548695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 86a0b6c88fe84ba0907d515fd9f38e72 May 17 17:14:49.548695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1404132781-project May 17 17:14:49.548695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:14:49.548695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:14:49.548695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': 'b074c961-149b-4667-addc-790568769b88'} May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:14:49.549653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:14:49.550918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:49.552980 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1db2a240-603d-49d8-bb59-a869e9307435 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Returning 404 to user: Instance b074c961-149b-4667-addc-790568769b88 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:14:49.553862 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1db2a240-603d-49d8-bb59-a869e9307435 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 404 len: 111 microversion: 2.20 time: 0.056310 May 17 17:14:49.557857 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 299/633] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:14:49 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 17:14:49.565952 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f7d13220-5ee7-471d-ab85-36426908830d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '.version_select at 0x7feb12fec4c0>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:49.604952 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f7d13220-5ee7-471d-ab85-36426908830d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552181083" status: 204 len: 0 microversion: 2.20 time: 0.045022 May 17 17:14:49.605770 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 335/634] 10.222.0.48 () {60 vars in 1261 bytes} [Tue May 17 17:14:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552181083 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 17:14:50.179249 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-cdd3943c-dc0e-4385-b8bd-595d60735133 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:50.179878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-cdd3943c-dc0e-4385-b8bd-595d60735133 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:50.186030 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-cdd3943c-dc0e-4385-b8bd-595d60735133 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:50.186664 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-cdd3943c-dc0e-4385-b8bd-595d60735133 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:50.187494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-cdd3943c-dc0e-4385-b8bd-595d60735133 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:50.187961 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-cdd3943c-dc0e-4385-b8bd-595d60735133 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:50.202014 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-cdd3943c-dc0e-4385-b8bd-595d60735133 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] HTTP exception thrown: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-cdd3943c-dc0e-4385-b8bd-595d60735133 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Request method failure captured: May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 HTTP/1.1 May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9dPWJVb7qwYBnOyu2SibnIHb7br9I07PYlwLrrT_SRrqmmG-Yk2L4b9g7-opL8KlEa-VvVIvtF7WR6pTkYQoWCb_iUMaherr4GYvkZBEx7i_4xoMizUYe3fXvOKjqnKrfi4cSl1B6_TYNoX5UI1IzkedqJD3SKAMFqJ-H9rW400QlM May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:14:50.203477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:14:50.205060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:14:50.205060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:14:50.205060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:14:50.205060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:14:50.205060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:14:50.205060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:14:50.205060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:14:50.205060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 61daaf70d25c4e1592fcb2f4feafff86 May 17 17:14:50.205060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:14:50.205060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:14:50.205060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:14:50.205060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': 'cb476330-5832-4b1c-bc73-9e902cbb77b2'} May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:14:50.205986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:14:50.207216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:50.208943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-cdd3943c-dc0e-4385-b8bd-595d60735133 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Returning 404 to user: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:14:50.208943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-cdd3943c-dc0e-4385-b8bd-595d60735133 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 404 len: 111 microversion: 2.1 time: 0.030181 May 17 17:14:50.208943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 300/635] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:50 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:14:50.214004 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a0138e80-4e99-48a9-af6f-a4b960dde48f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '.version_select at 0x7feb181d71f0>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:50.240992 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a0138e80-4e99-48a9-af6f-a4b960dde48f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980803640" status: 202 len: 0 microversion: 2.1 time: 0.030559 May 17 17:14:50.254004 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 336/636] 10.222.0.48 () {58 vars in 1220 bytes} [Tue May 17 17:14:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980803640 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:14:50.331441 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-c5989b65-d93a-4abc-94a1-dfae93205b7a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Action: 'create', calling method: .version_select at 0x7feb137faa60>, body: {"keypair": {"name": "tempest-keypair-1223346154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFfPApYa5PLvf+hp4Na8bNIA1AySApowm0hIW8Ckc+VWzJ8e/oPAweWh+oCJUZnlbNIqsTbf/iNMlpRhRIkEvAsvxpMm3mvqnQdbex4VlO1bEz9JhDEdQ9teMapzBNvEQ=="}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:50.348883 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-3bde74ac-a934-4559-85c9-9f29936527f5 req-88843d14-d11b-48a2-848c-305f4add22f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb476330-5832-4b1c-bc73-9e902cbb77b2", "name": "network-vif-deleted", "tag": "aad19b71-6714-499c-a78e-11636c0b7474"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:50.355562 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-c5989b65-d93a-4abc-94a1-dfae93205b7a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Getting quotas for project 9d587d1ef11b4055b77055e6fbcc1899. Resources: {'key_pairs'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:14:50.364555 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-3bde74ac-a934-4559-85c9-9f29936527f5 req-88843d14-d11b-48a2-848c-305f4add22f7 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:50.365036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-3bde74ac-a934-4559-85c9-9f29936527f5 req-88843d14-d11b-48a2-848c-305f4add22f7 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:50.368846 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-c5989b65-d93a-4abc-94a1-dfae93205b7a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Getting quotas for user 86a0b6c88fe84ba0907d515fd9f38e72 and project 9d587d1ef11b4055b77055e6fbcc1899. Resources: {'key_pairs'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:14:50.378261 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-3bde74ac-a934-4559-85c9-9f29936527f5 req-88843d14-d11b-48a2-848c-305f4add22f7 service nova] Creating event network-vif-deleted:aad19b71-6714-499c-a78e-11636c0b7474 for instance cb476330-5832-4b1c-bc73-9e902cbb77b2 on hv-cinder-84214 May 17 17:14:50.383295 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-3bde74ac-a934-4559-85c9-9f29936527f5 req-88843d14-d11b-48a2-848c-305f4add22f7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041390 May 17 17:14:50.387187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 337/637] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:14:50.399177 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-c5989b65-d93a-4abc-94a1-dfae93205b7a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.072432 May 17 17:14:50.405842 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 301/638] 10.222.0.48 () {62 vars in 1199 bytes} [Tue May 17 17:14:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 17 17:14:51.097355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-0cdbbfaf-7752-4295-84ce-44d5ee2a7b33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:51.098055 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-0cdbbfaf-7752-4295-84ce-44d5ee2a7b33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:51.105675 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0cdbbfaf-7752-4295-84ce-44d5ee2a7b33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:51.106148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0cdbbfaf-7752-4295-84ce-44d5ee2a7b33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:51.107022 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0cdbbfaf-7752-4295-84ce-44d5ee2a7b33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:51.107529 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0cdbbfaf-7752-4295-84ce-44d5ee2a7b33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:51.206772 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-0cdbbfaf-7752-4295-84ce-44d5ee2a7b33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lazy-loading 'services' on Instance uuid 0a762b56-1a2c-4556-90cb-52de211c17a5 {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:14:51.292851 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-0cdbbfaf-7752-4295-84ce-44d5ee2a7b33 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5/os-volume_attachments/548d5cdb-63b3-48e0-9170-ea0334b16444" status: 202 len: 0 microversion: 2.1 time: 0.200281 May 17 17:14:51.293893 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 338/639] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 17 17:14:51 2022] DELETE /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5/os-volume_attachments/548d5cdb-63b3-48e0-9170-ea0334b16444 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:14:51.303521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0420d53a-c3c1-4b64-9962-cbd9ab6b5e55 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:51.309686 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0420d53a-c3c1-4b64-9962-cbd9ab6b5e55 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:51.319384 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0420d53a-c3c1-4b64-9962-cbd9ab6b5e55 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:51.320187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0420d53a-c3c1-4b64-9962-cbd9ab6b5e55 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:51.321213 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0420d53a-c3c1-4b64-9962-cbd9ab6b5e55 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:51.322442 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0420d53a-c3c1-4b64-9962-cbd9ab6b5e55 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:51.379248 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0420d53a-c3c1-4b64-9962-cbd9ab6b5e55 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081131 May 17 17:14:51.379872 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 302/640] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:14:51 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:51.878440 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1832521144", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cabe2e00-7fdc-4f66-a15c-c9987c464947"}], "security_groups": [{"name": "tempest-securitygroup--821638098"}], "key_name": "tempest-keypair-1223346154", "user_data": "}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:51.988695 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.network.neutron [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] validate_networks() for [('cabe2e00-7fdc-4f66-a15c-c9987c464947', None, None, None, None, None)] {{(pid=117090) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:14:52.355468 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Flavor limits 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:14:52.356086 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Image limits 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:14:52.356400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Flavor pref 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:14:52.356827 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Image pref 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:14:52.357238 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:14:52.365933 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:52.366384 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:52.367182 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:52.367637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:52.383588 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Getting quotas for project 9d587d1ef11b4055b77055e6fbcc1899. Resources: {'ram', 'instances', 'cores'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:14:52.387531 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Getting quotas for user 86a0b6c88fe84ba0907d515fd9f38e72 and project 9d587d1ef11b4055b77055e6fbcc1899. Resources: {'ram', 'instances', 'cores'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:14:52.390425 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3091f9e8-92b3-4047-9ccf-19af216bee77 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:52.391352 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3091f9e8-92b3-4047-9ccf-19af216bee77 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:52.398140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3091f9e8-92b3-4047-9ccf-19af216bee77 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:52.398590 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3091f9e8-92b3-4047-9ccf-19af216bee77 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:52.399084 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Going to run 1 instances... {{(pid=117090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:14:52.399348 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3091f9e8-92b3-4047-9ccf-19af216bee77 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:52.399817 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3091f9e8-92b3-4047-9ccf-19af216bee77 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:52.401466 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:14:52.428171 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3091f9e8-92b3-4047-9ccf-19af216bee77 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041643 May 17 17:14:52.428980 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 303/641] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:14:52 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 17 17:14:52.450827 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-01569502-ceb1-4af9-857e-1f0c669d037f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.577014 May 17 17:14:52.451803 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 339/642] 10.222.0.48 () {62 vars in 1187 bytes} [Tue May 17 17:14:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 17 17:14:52.463143 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-26fb92b4-65e4-4a11-82e2-1923ead5a9e3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:52.463880 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-26fb92b4-65e4-4a11-82e2-1923ead5a9e3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:52.491579 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9d779540-deb6-4824-b2cb-f3cf946cbc6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:52.492372 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9d779540-deb6-4824-b2cb-f3cf946cbc6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:52.500276 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9d779540-deb6-4824-b2cb-f3cf946cbc6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:52.500802 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9d779540-deb6-4824-b2cb-f3cf946cbc6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:52.502535 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9d779540-deb6-4824-b2cb-f3cf946cbc6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:52.503206 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9d779540-deb6-4824-b2cb-f3cf946cbc6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:52.523836 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-26fb92b4-65e4-4a11-82e2-1923ead5a9e3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:52.530674 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9d779540-deb6-4824-b2cb-f3cf946cbc6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Going to try to terminate instance {{(pid=117090) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:14:52.531725 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-26fb92b4-65e4-4a11-82e2-1923ead5a9e3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:52.533401 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-26fb92b4-65e4-4a11-82e2-1923ead5a9e3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:52.534634 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-26fb92b4-65e4-4a11-82e2-1923ead5a9e3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1282 microversion: 2.20 time: 0.075553 May 17 17:14:52.539651 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 304/643] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:14:52 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:14:52.611668 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9d779540-deb6-4824-b2cb-f3cf946cbc6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 204 len: 0 microversion: 2.1 time: 0.123406 May 17 17:14:52.612513 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 340/644] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:14:52 2022] DELETE /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 17:14:52.620733 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-875d6140-496f-46f0-9b81-790bd8e1052e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:52.621435 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-875d6140-496f-46f0-9b81-790bd8e1052e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:52.628688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-875d6140-496f-46f0-9b81-790bd8e1052e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:52.629238 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-875d6140-496f-46f0-9b81-790bd8e1052e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:52.630083 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-875d6140-496f-46f0-9b81-790bd8e1052e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:52.630629 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-875d6140-496f-46f0-9b81-790bd8e1052e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:52.786149 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-875d6140-496f-46f0-9b81-790bd8e1052e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:52.793732 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-875d6140-496f-46f0-9b81-790bd8e1052e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1680 microversion: 2.1 time: 0.176957 May 17 17:14:52.794296 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 305/645] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:52 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:53.554683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c4b8ec7c-c124-4e99-b70e-7d55fbfea726 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:53.555378 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c4b8ec7c-c124-4e99-b70e-7d55fbfea726 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:53.561723 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c4b8ec7c-c124-4e99-b70e-7d55fbfea726 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:53.562173 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c4b8ec7c-c124-4e99-b70e-7d55fbfea726 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:53.562930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c4b8ec7c-c124-4e99-b70e-7d55fbfea726 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:53.563423 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c4b8ec7c-c124-4e99-b70e-7d55fbfea726 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:53.624457 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c4b8ec7c-c124-4e99-b70e-7d55fbfea726 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:53.632206 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c4b8ec7c-c124-4e99-b70e-7d55fbfea726 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:53.633698 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c4b8ec7c-c124-4e99-b70e-7d55fbfea726 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:53.634774 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c4b8ec7c-c124-4e99-b70e-7d55fbfea726 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1286 microversion: 2.20 time: 0.084495 May 17 17:14:53.635319 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 341/646] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:14:53 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:14:53.812413 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-37688f27-fc7a-4b9e-8fbb-9a00d2b9bbc3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:53.813025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-37688f27-fc7a-4b9e-8fbb-9a00d2b9bbc3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:53.819569 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-37688f27-fc7a-4b9e-8fbb-9a00d2b9bbc3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:53.820048 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-37688f27-fc7a-4b9e-8fbb-9a00d2b9bbc3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:53.820806 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-37688f27-fc7a-4b9e-8fbb-9a00d2b9bbc3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:53.821237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-37688f27-fc7a-4b9e-8fbb-9a00d2b9bbc3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:53.948128 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-37688f27-fc7a-4b9e-8fbb-9a00d2b9bbc3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:53.956264 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-37688f27-fc7a-4b9e-8fbb-9a00d2b9bbc3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1680 microversion: 2.1 time: 0.147621 May 17 17:14:53.956826 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 306/647] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:53 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:54.653074 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-84b3871a-1a31-4bf4-ba4b-ee431350e08a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:54.653667 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-84b3871a-1a31-4bf4-ba4b-ee431350e08a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:54.660420 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-84b3871a-1a31-4bf4-ba4b-ee431350e08a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:54.660862 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-84b3871a-1a31-4bf4-ba4b-ee431350e08a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:54.661611 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-84b3871a-1a31-4bf4-ba4b-ee431350e08a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:54.662039 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-84b3871a-1a31-4bf4-ba4b-ee431350e08a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:54.724406 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-84b3871a-1a31-4bf4-ba4b-ee431350e08a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:54.732201 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-84b3871a-1a31-4bf4-ba4b-ee431350e08a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:54.733697 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-84b3871a-1a31-4bf4-ba4b-ee431350e08a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:54.734782 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-84b3871a-1a31-4bf4-ba4b-ee431350e08a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1334 microversion: 2.20 time: 0.085600 May 17 17:14:54.735331 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 342/648] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:14:54 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1334 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:14:54.973893 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2bc64a8c-9a84-4016-aea3-af3f6d575131 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:54.974501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2bc64a8c-9a84-4016-aea3-af3f6d575131 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:54.981033 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2bc64a8c-9a84-4016-aea3-af3f6d575131 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:54.981710 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2bc64a8c-9a84-4016-aea3-af3f6d575131 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:54.982495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2bc64a8c-9a84-4016-aea3-af3f6d575131 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:54.983340 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2bc64a8c-9a84-4016-aea3-af3f6d575131 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:55.122081 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2bc64a8c-9a84-4016-aea3-af3f6d575131 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:55.129962 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2bc64a8c-9a84-4016-aea3-af3f6d575131 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1680 microversion: 2.1 time: 0.160114 May 17 17:14:55.130532 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 307/649] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:54 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:55.752801 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8c63e0c1-c4a1-4c4e-8ca1-becc588fa2a9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:55.754240 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8c63e0c1-c4a1-4c4e-8ca1-becc588fa2a9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:55.760467 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8c63e0c1-c4a1-4c4e-8ca1-becc588fa2a9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:55.760919 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8c63e0c1-c4a1-4c4e-8ca1-becc588fa2a9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:55.761692 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8c63e0c1-c4a1-4c4e-8ca1-becc588fa2a9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:55.762130 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8c63e0c1-c4a1-4c4e-8ca1-becc588fa2a9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:55.828062 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8c63e0c1-c4a1-4c4e-8ca1-becc588fa2a9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:55.836568 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8c63e0c1-c4a1-4c4e-8ca1-becc588fa2a9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:55.838080 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8c63e0c1-c4a1-4c4e-8ca1-becc588fa2a9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:55.839180 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8c63e0c1-c4a1-4c4e-8ca1-becc588fa2a9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1340 microversion: 2.20 time: 0.090421 May 17 17:14:55.840471 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 343/650] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:14:55 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1340 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:14:55.997314 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-6a309ef1-5875-44b0-9d6d-028639d71046 req-a7036d7e-f6b9-4d4a-a3fb-c9f4cdc1090b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a762b56-1a2c-4556-90cb-52de211c17a5", "name": "network-vif-deleted", "tag": "1d705197-7ce1-4547-af7a-185fa88a47c8"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:56.008028 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-6a309ef1-5875-44b0-9d6d-028639d71046 req-a7036d7e-f6b9-4d4a-a3fb-c9f4cdc1090b service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:56.008757 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-6a309ef1-5875-44b0-9d6d-028639d71046 req-a7036d7e-f6b9-4d4a-a3fb-c9f4cdc1090b service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:56.029741 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-6a309ef1-5875-44b0-9d6d-028639d71046 req-a7036d7e-f6b9-4d4a-a3fb-c9f4cdc1090b service nova] Creating event network-vif-deleted:1d705197-7ce1-4547-af7a-185fa88a47c8 for instance 0a762b56-1a2c-4556-90cb-52de211c17a5 on hv-cinder-84214 May 17 17:14:56.048235 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-6a309ef1-5875-44b0-9d6d-028639d71046 req-a7036d7e-f6b9-4d4a-a3fb-c9f4cdc1090b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054627 May 17 17:14:56.049155 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 308/651] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:56.149059 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-bebb2c8c-3fbc-47a0-a7a3-f27da24df7b9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:56.150017 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-bebb2c8c-3fbc-47a0-a7a3-f27da24df7b9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:56.156811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bebb2c8c-3fbc-47a0-a7a3-f27da24df7b9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:56.157276 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bebb2c8c-3fbc-47a0-a7a3-f27da24df7b9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:56.158042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bebb2c8c-3fbc-47a0-a7a3-f27da24df7b9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:56.158476 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bebb2c8c-3fbc-47a0-a7a3-f27da24df7b9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:56.196269 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bebb2c8c-3fbc-47a0-a7a3-f27da24df7b9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:56.196724 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bebb2c8c-3fbc-47a0-a7a3-f27da24df7b9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:56.197188 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-bebb2c8c-3fbc-47a0-a7a3-f27da24df7b9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lazy-loading 'fault' on Instance uuid 0a762b56-1a2c-4556-90cb-52de211c17a5 {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:14:56.240177 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-bebb2c8c-3fbc-47a0-a7a3-f27da24df7b9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:56.248236 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-bebb2c8c-3fbc-47a0-a7a3-f27da24df7b9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 200 len: 1330 microversion: 2.1 time: 0.104605 May 17 17:14:56.249040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 344/652] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:56 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:56.858114 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-92e1e3f0-62a3-45b2-a27d-65e529aae795 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:56.858823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-92e1e3f0-62a3-45b2-a27d-65e529aae795 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:56.866285 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-92e1e3f0-62a3-45b2-a27d-65e529aae795 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:56.866717 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-92e1e3f0-62a3-45b2-a27d-65e529aae795 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:56.867446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-92e1e3f0-62a3-45b2-a27d-65e529aae795 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:56.868097 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-92e1e3f0-62a3-45b2-a27d-65e529aae795 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:57.078640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-92e1e3f0-62a3-45b2-a27d-65e529aae795 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:57.102880 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-92e1e3f0-62a3-45b2-a27d-65e529aae795 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:57.107544 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-92e1e3f0-62a3-45b2-a27d-65e529aae795 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:57.114146 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-92e1e3f0-62a3-45b2-a27d-65e529aae795 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1407 microversion: 2.20 time: 0.256893 May 17 17:14:57.115998 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 309/653] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:14:56 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:14:57.195546 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1942696243", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-402373830", "security_groups": [{"name": "tempest-secgroup-smoke-927017117"}], "block_device_mapping_v2": [{"uuid": "346e8d86-df39-416a-9bf6-e28630331815", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f954c18a-8821-47ca-8b80-a2fbc154db5e"}]}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:57.266154 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1fdca04f-2f61-4758-952d-3d932caf4966 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:57.266765 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1fdca04f-2f61-4758-952d-3d932caf4966 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:57.273393 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1fdca04f-2f61-4758-952d-3d932caf4966 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:57.273849 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1fdca04f-2f61-4758-952d-3d932caf4966 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:57.274630 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1fdca04f-2f61-4758-952d-3d932caf4966 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:57.275058 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1fdca04f-2f61-4758-952d-3d932caf4966 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:57.292202 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-1fdca04f-2f61-4758-952d-3d932caf4966 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] HTTP exception thrown: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1fdca04f-2f61-4758-952d-3d932caf4966 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Request method failure captured: May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 HTTP/1.1 May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9dPWJVb7qwYBnOyu2SibnIHb7br9I07PYlwLrrT_SRrqmmG-Yk2L4b9g7-opL8KlEa-VvVIvtF7WR6pTkYQoWCb_iUMaherr4GYvkZBEx7i_4xoMizUYe3fXvOKjqnKrfi4cSl1B6_TYNoX5UI1IzkedqJD3SKAMFqJ-H9rW400QlM May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:14:57.294153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:14:57.295780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:14:57.295780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:14:57.295780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:14:57.295780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:14:57.295780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:14:57.295780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:14:57.295780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:14:57.295780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 61daaf70d25c4e1592fcb2f4feafff86 May 17 17:14:57.295780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:14:57.295780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:14:57.295780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:14:57.295780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': '0a762b56-1a2c-4556-90cb-52de211c17a5'} May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:14:57.296702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:14:57.298381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:14:57.301982 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1fdca04f-2f61-4758-952d-3d932caf4966 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Returning 404 to user: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:14:57.303135 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1fdca04f-2f61-4758-952d-3d932caf4966 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 404 len: 111 microversion: 2.1 time: 0.040969 May 17 17:14:57.307234 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 310/654] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:57 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:14:57.313402 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-c61448b0-f015-4d3b-9561-b6922a07b3d0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '.version_select at 0x7feb1805d700>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:57.340076 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-c61448b0-f015-4d3b-9561-b6922a07b3d0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-646647193" status: 202 len: 0 microversion: 2.1 time: 0.031537 May 17 17:14:57.344402 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 311/655] 10.222.0.48 () {58 vars in 1217 bytes} [Tue May 17 17:14:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-646647193 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:14:57.513845 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.network.neutron [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] validate_networks() for [('f954c18a-8821-47ca-8b80-a2fbc154db5e', None, None, None, None, None)] {{(pid=117090) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:14:58.064403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-97328025-8929-4b7a-b0cf-e8e9fdf3594c req-0401a315-8e40-4061-bf68-39ad108d45c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6de88f8-538f-45eb-bfcd-fce744a5c55d", "tag": "e349ab19-ab43-4bf5-8128-4ce8f8b7a5f5"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:58.075148 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-97328025-8929-4b7a-b0cf-e8e9fdf3594c req-0401a315-8e40-4061-bf68-39ad108d45c5 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:58.075592 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-97328025-8929-4b7a-b0cf-e8e9fdf3594c req-0401a315-8e40-4061-bf68-39ad108d45c5 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:58.086036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-97328025-8929-4b7a-b0cf-e8e9fdf3594c req-0401a315-8e40-4061-bf68-39ad108d45c5 service nova] Creating event network-changed:e349ab19-ab43-4bf5-8128-4ce8f8b7a5f5 for instance b6de88f8-538f-45eb-bfcd-fce744a5c55d on hv-cinder-84214 May 17 17:14:58.091407 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-97328025-8929-4b7a-b0cf-e8e9fdf3594c req-0401a315-8e40-4061-bf68-39ad108d45c5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031099 May 17 17:14:58.092362 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 312/656] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:14:58.133731 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-5971b554-d468-4efe-9ebe-e71e864dc08c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:58.134443 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-5971b554-d468-4efe-9ebe-e71e864dc08c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:58.140585 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5971b554-d468-4efe-9ebe-e71e864dc08c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:58.141038 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5971b554-d468-4efe-9ebe-e71e864dc08c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:58.141808 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5971b554-d468-4efe-9ebe-e71e864dc08c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:58.142241 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5971b554-d468-4efe-9ebe-e71e864dc08c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:58.433502 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5971b554-d468-4efe-9ebe-e71e864dc08c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:58.441875 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5971b554-d468-4efe-9ebe-e71e864dc08c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:58.443378 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5971b554-d468-4efe-9ebe-e71e864dc08c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:58.444510 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-5971b554-d468-4efe-9ebe-e71e864dc08c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1407 microversion: 2.20 time: 0.315059 May 17 17:14:58.445055 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 313/657] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:14:58 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:14:58.456037 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Flavor limits 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:14:58.457295 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Image limits 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:14:58.457770 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Flavor pref 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:14:58.458172 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Image pref 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:14:58.458603 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:14:58.467570 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:58.468047 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:58.468834 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:58.469269 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:58.485648 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Getting quotas for project b1528992e3c74c08b5c4192466f23852. Resources: {'ram', 'instances', 'cores'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:14:58.489593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Getting quotas for user 38bdb5f8e08e49358f9f27e4f1ce167b and project b1528992e3c74c08b5c4192466f23852. Resources: {'ram', 'instances', 'cores'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:14:58.545001 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Going to run 1 instances... {{(pid=117090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:14:58.547066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='346e8d86-df39-416a-9bf6-e28630331815',volume_size=None,volume_type=None)] {{(pid=117090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:14:58.687354 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-31c36fe9-b31d-4a52-9b7b-2092072b6d5b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.499674 May 17 17:14:58.688055 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 345/658] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:14:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:14:58.701838 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ebccb1f7-aa8b-45ed-8907-13de802f73db tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:58.702459 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ebccb1f7-aa8b-45ed-8907-13de802f73db tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:58.702607 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-fd4b8bed-6b35-4319-83b2-59e988ed2292 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Action: 'create', calling method: .version_select at 0x7feb12f7ba60>, body: {"keypair": {"name": "tempest-keypair-1325258293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCr1Z6d+BrwoOQJCi2A4FA4Yv6AkwzxLXL+nnBpsrDjH1SXzT51g0EgChv3i3V8GytO25QrPWzHCNCTzAvFhjOrMDJ7wA850ZzQ85v46h920fNDohwuMZJzXgGdRzohsSg=="}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:58.730243 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-fd4b8bed-6b35-4319-83b2-59e988ed2292 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'key_pairs'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:14:58.734146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-fd4b8bed-6b35-4319-83b2-59e988ed2292 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for user 61daaf70d25c4e1592fcb2f4feafff86 and project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'key_pairs'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:14:58.756881 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-fd4b8bed-6b35-4319-83b2-59e988ed2292 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058093 May 17 17:14:58.757555 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 346/659] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 17 17:14:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:58.778587 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ebccb1f7-aa8b-45ed-8907-13de802f73db tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:58.789747 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ebccb1f7-aa8b-45ed-8907-13de802f73db tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1094 microversion: 2.1 time: 0.092530 May 17 17:14:58.790584 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 314/660] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:58 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:59.462912 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a09921d2-9330-4164-8535-1cd38a145707 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:59.463457 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a09921d2-9330-4164-8535-1cd38a145707 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:59.470507 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a09921d2-9330-4164-8535-1cd38a145707 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:59.470953 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a09921d2-9330-4164-8535-1cd38a145707 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:59.471741 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a09921d2-9330-4164-8535-1cd38a145707 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:59.472194 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a09921d2-9330-4164-8535-1cd38a145707 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:59.657980 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a09921d2-9330-4164-8535-1cd38a145707 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:59.679545 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a09921d2-9330-4164-8535-1cd38a145707 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:59.682066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a09921d2-9330-4164-8535-1cd38a145707 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:59.683402 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a09921d2-9330-4164-8535-1cd38a145707 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1407 microversion: 2.20 time: 0.224976 May 17 17:14:59.684556 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 347/661] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:14:59 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:14:59.807157 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-632a9281-751b-401c-a90b-d4ad534869af tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:59.807797 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-632a9281-751b-401c-a90b-d4ad534869af tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:14:59.818010 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-632a9281-751b-401c-a90b-d4ad534869af tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:59.819089 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-632a9281-751b-401c-a90b-d4ad534869af tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:59.820061 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-632a9281-751b-401c-a90b-d4ad534869af tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:14:59.820649 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-632a9281-751b-401c-a90b-d4ad534869af tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:14:59.919354 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-632a9281-751b-401c-a90b-d4ad534869af tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:14:59.929146 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-632a9281-751b-401c-a90b-d4ad534869af tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1210 microversion: 2.1 time: 0.125939 May 17 17:14:59.930271 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 315/662] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:14:59 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1210 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:00.285001 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1654281897", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30541785-dceb-40b7-9575-992b66a470e9"}], "security_groups": [{"name": "tempest-securitygroup--566476457"}], "key_name": "tempest-keypair-1325258293", "user_data": "}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:00.398533 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.network.neutron [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] validate_networks() for [('30541785-dceb-40b7-9575-992b66a470e9', None, None, None, None, None)] {{(pid=117090) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:15:00.701620 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1fc5d152-e69a-4853-a0bc-e46bde3993c0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:00.702525 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1fc5d152-e69a-4853-a0bc-e46bde3993c0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:00.710309 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1fc5d152-e69a-4853-a0bc-e46bde3993c0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:00.711019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1fc5d152-e69a-4853-a0bc-e46bde3993c0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:00.712044 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1fc5d152-e69a-4853-a0bc-e46bde3993c0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:00.712701 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1fc5d152-e69a-4853-a0bc-e46bde3993c0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:00.874769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Flavor limits 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:15:00.875794 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Image limits 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:15:00.876276 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Flavor pref 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:15:00.876689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Image pref 0:0:0 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:15:00.877738 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.virt.hardware [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117090) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:15:00.888025 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:00.888479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:00.889421 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:00.889866 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:00.898126 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1fc5d152-e69a-4853-a0bc-e46bde3993c0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:00.908130 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'ram', 'instances', 'cores'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:15:00.913137 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for user 61daaf70d25c4e1592fcb2f4feafff86 and project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'ram', 'instances', 'cores'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:15:00.915982 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1fc5d152-e69a-4853-a0bc-e46bde3993c0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:00.918031 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1fc5d152-e69a-4853-a0bc-e46bde3993c0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:00.919398 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1fc5d152-e69a-4853-a0bc-e46bde3993c0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1407 microversion: 2.20 time: 0.221620 May 17 17:15:00.921543 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 316/663] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:15:00 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:00.935733 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Going to run 1 instances... {{(pid=117090) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:15:00.937895 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117090) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:15:00.949064 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8162fc86-0d24-484e-96c2-827850dc2c08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:00.950037 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8162fc86-0d24-484e-96c2-827850dc2c08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:00.959401 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8162fc86-0d24-484e-96c2-827850dc2c08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:00.960179 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8162fc86-0d24-484e-96c2-827850dc2c08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:00.961091 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8162fc86-0d24-484e-96c2-827850dc2c08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:00.962249 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8162fc86-0d24-484e-96c2-827850dc2c08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:01.007652 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b0ec6bfc-ff75-4d3c-bcb0-eed589d4d443 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.728715 May 17 17:15:01.012861 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 348/664] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:15:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:15:01.023865 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5579a6ef-bac3-4d9f-87ea-b85af2e87d99 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:01.028214 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5579a6ef-bac3-4d9f-87ea-b85af2e87d99 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:01.145238 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5579a6ef-bac3-4d9f-87ea-b85af2e87d99 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:01.154795 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5579a6ef-bac3-4d9f-87ea-b85af2e87d99 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1242 microversion: 2.1 time: 0.136104 May 17 17:15:01.157198 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 349/665] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:01 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1242 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:01.179361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-8162fc86-0d24-484e-96c2-827850dc2c08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:01.187387 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8162fc86-0d24-484e-96c2-827850dc2c08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1265 microversion: 2.1 time: 0.243597 May 17 17:15:01.189125 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 317/666] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:00 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:01.221400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-e5f8870b-7843-45a2-ba1b-9ddfd5c35f22 req-9f7da064-dbcf-4d44-b262-105cd2bebe07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50898191-2e63-45d2-85bb-e47d9fe6d844", "tag": "efa762a5-a4d8-4cff-ba5a-528a674014b1"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:01.232623 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-e5f8870b-7843-45a2-ba1b-9ddfd5c35f22 req-9f7da064-dbcf-4d44-b262-105cd2bebe07 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:01.233318 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-e5f8870b-7843-45a2-ba1b-9ddfd5c35f22 req-9f7da064-dbcf-4d44-b262-105cd2bebe07 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:01.255285 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-e5f8870b-7843-45a2-ba1b-9ddfd5c35f22 req-9f7da064-dbcf-4d44-b262-105cd2bebe07 service nova] Creating event network-changed:efa762a5-a4d8-4cff-ba5a-528a674014b1 for instance 50898191-2e63-45d2-85bb-e47d9fe6d844 on hv-cinder-84214 May 17 17:15:01.260451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-e5f8870b-7843-45a2-ba1b-9ddfd5c35f22 req-9f7da064-dbcf-4d44-b262-105cd2bebe07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042676 May 17 17:15:01.261185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 350/667] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:01.745287 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-7b679e12-e8fa-45ae-a038-70f886ac80f4 req-4aba0497-2823-424e-a4ca-e24c2fa12172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6de88f8-538f-45eb-bfcd-fce744a5c55d", "name": "network-vif-plugged", "status": "completed", "tag": "e349ab19-ab43-4bf5-8128-4ce8f8b7a5f5"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:01.754290 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-7b679e12-e8fa-45ae-a038-70f886ac80f4 req-4aba0497-2823-424e-a4ca-e24c2fa12172 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:01.754740 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-7b679e12-e8fa-45ae-a038-70f886ac80f4 req-4aba0497-2823-424e-a4ca-e24c2fa12172 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:01.766305 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-7b679e12-e8fa-45ae-a038-70f886ac80f4 req-4aba0497-2823-424e-a4ca-e24c2fa12172 service nova] Creating event network-vif-plugged:e349ab19-ab43-4bf5-8128-4ce8f8b7a5f5 for instance b6de88f8-538f-45eb-bfcd-fce744a5c55d on hv-cinder-84214 May 17 17:15:01.771699 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-7b679e12-e8fa-45ae-a038-70f886ac80f4 req-4aba0497-2823-424e-a4ca-e24c2fa12172 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030062 May 17 17:15:01.772291 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 318/668] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:01.942740 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-30f9c9db-5073-41da-9557-a8cf52bbb861 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:01.943333 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-30f9c9db-5073-41da-9557-a8cf52bbb861 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:01.949580 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-30f9c9db-5073-41da-9557-a8cf52bbb861 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:01.950040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-30f9c9db-5073-41da-9557-a8cf52bbb861 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:01.950815 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-30f9c9db-5073-41da-9557-a8cf52bbb861 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:01.951256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-30f9c9db-5073-41da-9557-a8cf52bbb861 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:02.078410 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-30f9c9db-5073-41da-9557-a8cf52bbb861 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:02.086939 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-30f9c9db-5073-41da-9557-a8cf52bbb861 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:02.088533 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-30f9c9db-5073-41da-9557-a8cf52bbb861 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:02.089668 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-30f9c9db-5073-41da-9557-a8cf52bbb861 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1407 microversion: 2.20 time: 0.154036 May 17 17:15:02.090232 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 351/669] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:15:01 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:02.173623 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6120c786-ff95-46ba-be7d-46184dbf0724 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:02.175564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6120c786-ff95-46ba-be7d-46184dbf0724 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:02.183229 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6120c786-ff95-46ba-be7d-46184dbf0724 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:02.184008 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6120c786-ff95-46ba-be7d-46184dbf0724 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:02.185057 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6120c786-ff95-46ba-be7d-46184dbf0724 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:02.185501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6120c786-ff95-46ba-be7d-46184dbf0724 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:02.205156 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d7b9d643-f54c-4a63-ab8f-7b0e681c3647 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:02.206630 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d7b9d643-f54c-4a63-ab8f-7b0e681c3647 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:02.213015 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d7b9d643-f54c-4a63-ab8f-7b0e681c3647 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:02.213737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d7b9d643-f54c-4a63-ab8f-7b0e681c3647 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:02.214693 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d7b9d643-f54c-4a63-ab8f-7b0e681c3647 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:02.215421 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d7b9d643-f54c-4a63-ab8f-7b0e681c3647 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:02.280025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6120c786-ff95-46ba-be7d-46184dbf0724 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:02.293240 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6120c786-ff95-46ba-be7d-46184dbf0724 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1294 microversion: 2.1 time: 0.123439 May 17 17:15:02.294432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 319/670] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:02 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1294 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:02.400091 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d7b9d643-f54c-4a63-ab8f-7b0e681c3647 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:02.408521 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d7b9d643-f54c-4a63-ab8f-7b0e681c3647 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1265 microversion: 2.1 time: 0.207262 May 17 17:15:02.409130 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 352/671] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:02 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:03.108639 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-05f080ef-d8c4-4c99-9d44-49c6722493dc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:03.109256 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-05f080ef-d8c4-4c99-9d44-49c6722493dc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:03.115490 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-05f080ef-d8c4-4c99-9d44-49c6722493dc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:03.115980 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-05f080ef-d8c4-4c99-9d44-49c6722493dc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:03.116744 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-05f080ef-d8c4-4c99-9d44-49c6722493dc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:03.117177 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-05f080ef-d8c4-4c99-9d44-49c6722493dc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:03.244752 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-05f080ef-d8c4-4c99-9d44-49c6722493dc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:03.253621 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-05f080ef-d8c4-4c99-9d44-49c6722493dc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:03.255308 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-05f080ef-d8c4-4c99-9d44-49c6722493dc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:03.256500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-05f080ef-d8c4-4c99-9d44-49c6722493dc tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1407 microversion: 2.20 time: 0.151715 May 17 17:15:03.257062 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 320/672] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:15:03 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:03.315960 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7b59a340-6f26-4b36-b032-f3e9929fbbf2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:03.316696 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7b59a340-6f26-4b36-b032-f3e9929fbbf2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:03.323192 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7b59a340-6f26-4b36-b032-f3e9929fbbf2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:03.323764 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7b59a340-6f26-4b36-b032-f3e9929fbbf2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:03.324634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7b59a340-6f26-4b36-b032-f3e9929fbbf2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:03.325151 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7b59a340-6f26-4b36-b032-f3e9929fbbf2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:03.430779 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e3f287bb-d5cd-44c7-ad7c-78aa7d4bf740 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:03.431803 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e3f287bb-d5cd-44c7-ad7c-78aa7d4bf740 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:03.437709 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e3f287bb-d5cd-44c7-ad7c-78aa7d4bf740 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:03.438171 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e3f287bb-d5cd-44c7-ad7c-78aa7d4bf740 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:03.439003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e3f287bb-d5cd-44c7-ad7c-78aa7d4bf740 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:03.439454 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e3f287bb-d5cd-44c7-ad7c-78aa7d4bf740 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:03.520730 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7b59a340-6f26-4b36-b032-f3e9929fbbf2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:03.529437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7b59a340-6f26-4b36-b032-f3e9929fbbf2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1367 microversion: 2.1 time: 0.217785 May 17 17:15:03.530337 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 353/673] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:03 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:03.598905 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e3f287bb-d5cd-44c7-ad7c-78aa7d4bf740 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:03.606665 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e3f287bb-d5cd-44c7-ad7c-78aa7d4bf740 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1265 microversion: 2.1 time: 0.179709 May 17 17:15:03.607746 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 321/674] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:03 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:04.219217 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-5c534139-79f1-4069-b0da-c7ac4f233eda req-d492ea50-7ec1-4d9b-8dbb-4b109fd56ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d54d34-bc48-4fdd-8665-f9403cbb8c8f", "tag": "76a127a7-c717-441d-befd-aa3e03f6d0bc"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:04.229195 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-5c534139-79f1-4069-b0da-c7ac4f233eda req-d492ea50-7ec1-4d9b-8dbb-4b109fd56ef0 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:04.229645 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-5c534139-79f1-4069-b0da-c7ac4f233eda req-d492ea50-7ec1-4d9b-8dbb-4b109fd56ef0 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:04.241208 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-5c534139-79f1-4069-b0da-c7ac4f233eda req-d492ea50-7ec1-4d9b-8dbb-4b109fd56ef0 service nova] Creating event network-changed:76a127a7-c717-441d-befd-aa3e03f6d0bc for instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f on hv-cinder-84214 May 17 17:15:04.247068 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-5c534139-79f1-4069-b0da-c7ac4f233eda req-d492ea50-7ec1-4d9b-8dbb-4b109fd56ef0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031935 May 17 17:15:04.248012 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 354/675] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:15:04.275887 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-c93f3632-a4a3-44f1-aaf9-2039e17b28b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:04.277468 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-c93f3632-a4a3-44f1-aaf9-2039e17b28b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:04.286699 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c93f3632-a4a3-44f1-aaf9-2039e17b28b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:04.287422 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c93f3632-a4a3-44f1-aaf9-2039e17b28b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:04.288438 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c93f3632-a4a3-44f1-aaf9-2039e17b28b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:04.289086 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c93f3632-a4a3-44f1-aaf9-2039e17b28b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:04.454483 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-c93f3632-a4a3-44f1-aaf9-2039e17b28b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:04.462593 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-c93f3632-a4a3-44f1-aaf9-2039e17b28b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:04.464142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-c93f3632-a4a3-44f1-aaf9-2039e17b28b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:04.465247 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-c93f3632-a4a3-44f1-aaf9-2039e17b28b9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1407 microversion: 2.20 time: 0.193995 May 17 17:15:04.465804 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 322/676] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:15:04 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:04.549235 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ef67d50c-00a3-435d-9d90-036a72b0fa6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:04.550638 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ef67d50c-00a3-435d-9d90-036a72b0fa6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:04.557600 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ef67d50c-00a3-435d-9d90-036a72b0fa6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:04.558053 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ef67d50c-00a3-435d-9d90-036a72b0fa6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:04.558817 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ef67d50c-00a3-435d-9d90-036a72b0fa6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:04.559287 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ef67d50c-00a3-435d-9d90-036a72b0fa6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:04.624289 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-54258058-4b5b-41bf-818e-bf3c27f5fa09 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:04.625006 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-54258058-4b5b-41bf-818e-bf3c27f5fa09 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:04.632478 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-54258058-4b5b-41bf-818e-bf3c27f5fa09 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:04.633035 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-54258058-4b5b-41bf-818e-bf3c27f5fa09 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:04.633875 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-54258058-4b5b-41bf-818e-bf3c27f5fa09 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:04.634393 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-54258058-4b5b-41bf-818e-bf3c27f5fa09 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:04.718427 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ef67d50c-00a3-435d-9d90-036a72b0fa6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:04.726214 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ef67d50c-00a3-435d-9d90-036a72b0fa6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1367 microversion: 2.1 time: 0.181581 May 17 17:15:04.726785 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 355/677] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:04 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:04.781732 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-54258058-4b5b-41bf-818e-bf3c27f5fa09 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:04.789776 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-54258058-4b5b-41bf-818e-bf3c27f5fa09 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1265 microversion: 2.1 time: 0.169380 May 17 17:15:04.790425 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 323/678] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:04 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:05.483422 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-99b37e35-c001-488c-a2d7-822f5f71cfb9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:05.483943 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-99b37e35-c001-488c-a2d7-822f5f71cfb9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:05.490507 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99b37e35-c001-488c-a2d7-822f5f71cfb9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:05.490952 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99b37e35-c001-488c-a2d7-822f5f71cfb9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:05.491730 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99b37e35-c001-488c-a2d7-822f5f71cfb9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:05.492196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99b37e35-c001-488c-a2d7-822f5f71cfb9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:05.620458 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-99b37e35-c001-488c-a2d7-822f5f71cfb9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:05.628192 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-99b37e35-c001-488c-a2d7-822f5f71cfb9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:05.629678 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-99b37e35-c001-488c-a2d7-822f5f71cfb9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:05.630817 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-99b37e35-c001-488c-a2d7-822f5f71cfb9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1600 microversion: 2.20 time: 0.151386 May 17 17:15:05.631371 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 356/679] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:15:05 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:05.647952 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-fa702b10-68d8-4b5a-bf1f-c35b4225ded0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:05.648450 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-fa702b10-68d8-4b5a-bf1f-c35b4225ded0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:05.654709 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fa702b10-68d8-4b5a-bf1f-c35b4225ded0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:05.655191 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fa702b10-68d8-4b5a-bf1f-c35b4225ded0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:05.655993 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fa702b10-68d8-4b5a-bf1f-c35b4225ded0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:05.656683 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fa702b10-68d8-4b5a-bf1f-c35b4225ded0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:05.731897 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-fa702b10-68d8-4b5a-bf1f-c35b4225ded0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087751 May 17 17:15:05.732490 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 324/680] 10.222.0.48 () {60 vars in 1315 bytes} [Tue May 17 17:15:05 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:15:05.743060 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2d489a71-fac5-4761-b76d-738cd5a24962 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:05.743696 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2d489a71-fac5-4761-b76d-738cd5a24962 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:05.749953 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2d489a71-fac5-4761-b76d-738cd5a24962 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:05.750376 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2d489a71-fac5-4761-b76d-738cd5a24962 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:05.751131 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2d489a71-fac5-4761-b76d-738cd5a24962 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:05.751561 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2d489a71-fac5-4761-b76d-738cd5a24962 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:05.806848 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0f620139-af4b-42a7-b4bd-2cd426640cc0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:05.807497 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0f620139-af4b-42a7-b4bd-2cd426640cc0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:05.813946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0f620139-af4b-42a7-b4bd-2cd426640cc0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:05.814406 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0f620139-af4b-42a7-b4bd-2cd426640cc0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:05.815947 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0f620139-af4b-42a7-b4bd-2cd426640cc0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:05.816096 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0f620139-af4b-42a7-b4bd-2cd426640cc0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:06.073260 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2d489a71-fac5-4761-b76d-738cd5a24962 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:06.080503 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2d489a71-fac5-4761-b76d-738cd5a24962 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1367 microversion: 2.1 time: 0.341406 May 17 17:15:06.081749 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 357/681] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:05 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:06.128582 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0f620139-af4b-42a7-b4bd-2cd426640cc0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:06.137390 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0f620139-af4b-42a7-b4bd-2cd426640cc0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1265 microversion: 2.1 time: 0.334412 May 17 17:15:06.138050 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 325/682] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:05 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1265 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:06.982276 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-fb2b2e00-d261-47b3-90cd-77beec61def8 req-f4b006bd-6fc3-4965-80bb-9ff1780e5870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6de88f8-538f-45eb-bfcd-fce744a5c55d", "tag": "e349ab19-ab43-4bf5-8128-4ce8f8b7a5f5"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:06.991174 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-fb2b2e00-d261-47b3-90cd-77beec61def8 req-f4b006bd-6fc3-4965-80bb-9ff1780e5870 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:06.991726 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-fb2b2e00-d261-47b3-90cd-77beec61def8 req-f4b006bd-6fc3-4965-80bb-9ff1780e5870 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:07.003190 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-fb2b2e00-d261-47b3-90cd-77beec61def8 req-f4b006bd-6fc3-4965-80bb-9ff1780e5870 service nova] Creating event network-changed:e349ab19-ab43-4bf5-8128-4ce8f8b7a5f5 for instance b6de88f8-538f-45eb-bfcd-fce744a5c55d on hv-cinder-84214 May 17 17:15:07.008107 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-fb2b2e00-d261-47b3-90cd-77beec61def8 req-f4b006bd-6fc3-4965-80bb-9ff1780e5870 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029504 May 17 17:15:07.008788 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 358/683] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:07.098695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-fa8e5d9b-31e8-4168-b031-24c775ed7015 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:07.099894 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-fa8e5d9b-31e8-4168-b031-24c775ed7015 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:07.106005 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fa8e5d9b-31e8-4168-b031-24c775ed7015 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:07.106457 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fa8e5d9b-31e8-4168-b031-24c775ed7015 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:07.107238 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fa8e5d9b-31e8-4168-b031-24c775ed7015 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:07.107712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fa8e5d9b-31e8-4168-b031-24c775ed7015 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:07.155183 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-15b2635e-80a0-40dc-aaeb-90bd33237288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:07.155914 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-15b2635e-80a0-40dc-aaeb-90bd33237288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:07.163266 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-15b2635e-80a0-40dc-aaeb-90bd33237288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:07.163740 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-15b2635e-80a0-40dc-aaeb-90bd33237288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:07.164517 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-15b2635e-80a0-40dc-aaeb-90bd33237288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:07.165156 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-15b2635e-80a0-40dc-aaeb-90bd33237288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:07.319279 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-fa8e5d9b-31e8-4168-b031-24c775ed7015 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:07.326948 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-fa8e5d9b-31e8-4168-b031-24c775ed7015 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1367 microversion: 2.1 time: 0.232736 May 17 17:15:07.328131 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 326/684] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:07 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:07.347481 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-15b2635e-80a0-40dc-aaeb-90bd33237288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:07.355737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-15b2635e-80a0-40dc-aaeb-90bd33237288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1265 microversion: 2.1 time: 0.204700 May 17 17:15:07.356538 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 359/685] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:07 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:08.344198 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-c4ad9ccd-5ee5-4efa-a5f3-5be79611591b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:08.345235 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-c4ad9ccd-5ee5-4efa-a5f3-5be79611591b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:08.354041 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c4ad9ccd-5ee5-4efa-a5f3-5be79611591b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:08.354490 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c4ad9ccd-5ee5-4efa-a5f3-5be79611591b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:08.355264 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c4ad9ccd-5ee5-4efa-a5f3-5be79611591b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:08.355733 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c4ad9ccd-5ee5-4efa-a5f3-5be79611591b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:08.372910 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d1014a07-6342-4879-bbbd-9bb44df04b98 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:08.373631 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d1014a07-6342-4879-bbbd-9bb44df04b98 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:08.380214 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d1014a07-6342-4879-bbbd-9bb44df04b98 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:08.380838 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d1014a07-6342-4879-bbbd-9bb44df04b98 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:08.381713 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d1014a07-6342-4879-bbbd-9bb44df04b98 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:08.382256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d1014a07-6342-4879-bbbd-9bb44df04b98 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:08.532943 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-c4ad9ccd-5ee5-4efa-a5f3-5be79611591b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:08.540242 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-c4ad9ccd-5ee5-4efa-a5f3-5be79611591b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1367 microversion: 2.1 time: 0.199963 May 17 17:15:08.540893 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 327/686] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:08 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:08.562500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d1014a07-6342-4879-bbbd-9bb44df04b98 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:08.570196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d1014a07-6342-4879-bbbd-9bb44df04b98 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1265 microversion: 2.1 time: 0.201186 May 17 17:15:08.570762 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 360/687] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:08 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:09.557270 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-fe0160b2-ec54-4f61-8318-651a0fac4f4a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:09.557879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-fe0160b2-ec54-4f61-8318-651a0fac4f4a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:09.564165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fe0160b2-ec54-4f61-8318-651a0fac4f4a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:09.564614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fe0160b2-ec54-4f61-8318-651a0fac4f4a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:09.566091 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fe0160b2-ec54-4f61-8318-651a0fac4f4a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:09.566520 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fe0160b2-ec54-4f61-8318-651a0fac4f4a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:09.586428 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-6c4a258c-ab58-451a-9351-fa2b4175073b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:09.587039 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-6c4a258c-ab58-451a-9351-fa2b4175073b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:09.594807 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6c4a258c-ab58-451a-9351-fa2b4175073b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:09.595266 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6c4a258c-ab58-451a-9351-fa2b4175073b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:09.596103 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6c4a258c-ab58-451a-9351-fa2b4175073b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:09.596584 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6c4a258c-ab58-451a-9351-fa2b4175073b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:09.767097 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-fe0160b2-ec54-4f61-8318-651a0fac4f4a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:09.775152 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-fe0160b2-ec54-4f61-8318-651a0fac4f4a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1367 microversion: 2.1 time: 0.221662 May 17 17:15:09.775938 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 328/688] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:09 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:09.785342 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-6c4a258c-ab58-451a-9351-fa2b4175073b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:09.793088 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-6c4a258c-ab58-451a-9351-fa2b4175073b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1265 microversion: 2.1 time: 0.210350 May 17 17:15:09.793850 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 361/689] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:09 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:09.880201 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-f81bbc71-72ff-470a-892a-d1375b0e0892 req-b80ea897-f5f5-430f-974a-17b416976ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d54d34-bc48-4fdd-8665-f9403cbb8c8f", "name": "network-vif-plugged", "status": "completed", "tag": "76a127a7-c717-441d-befd-aa3e03f6d0bc"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:09.888226 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-f81bbc71-72ff-470a-892a-d1375b0e0892 req-b80ea897-f5f5-430f-974a-17b416976ec4 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:09.888680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-f81bbc71-72ff-470a-892a-d1375b0e0892 req-b80ea897-f5f5-430f-974a-17b416976ec4 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:09.903072 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-f81bbc71-72ff-470a-892a-d1375b0e0892 req-b80ea897-f5f5-430f-974a-17b416976ec4 service nova] Creating event network-vif-plugged:76a127a7-c717-441d-befd-aa3e03f6d0bc for instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f on hv-cinder-84214 May 17 17:15:09.910552 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-f81bbc71-72ff-470a-892a-d1375b0e0892 req-b80ea897-f5f5-430f-974a-17b416976ec4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033614 May 17 17:15:09.911153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 329/690] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:10.792826 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b47c69f2-4701-41df-895d-efbe49299f7a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:10.793446 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b47c69f2-4701-41df-895d-efbe49299f7a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:10.799849 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b47c69f2-4701-41df-895d-efbe49299f7a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:10.800303 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b47c69f2-4701-41df-895d-efbe49299f7a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:10.801067 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b47c69f2-4701-41df-895d-efbe49299f7a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:10.801502 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b47c69f2-4701-41df-895d-efbe49299f7a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:10.809982 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-29000891-3b4d-490d-847f-2728c224ec39 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:10.810689 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-29000891-3b4d-490d-847f-2728c224ec39 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:10.817834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29000891-3b4d-490d-847f-2728c224ec39 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:10.818290 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29000891-3b4d-490d-847f-2728c224ec39 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:10.819063 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29000891-3b4d-490d-847f-2728c224ec39 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:10.819531 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-29000891-3b4d-490d-847f-2728c224ec39 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:10.996867 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b47c69f2-4701-41df-895d-efbe49299f7a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:11.001188 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-29000891-3b4d-490d-847f-2728c224ec39 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:11.005063 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b47c69f2-4701-41df-895d-efbe49299f7a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1367 microversion: 2.1 time: 0.216129 May 17 17:15:11.005770 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 362/691] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:10 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:11.009102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-29000891-3b4d-490d-847f-2728c224ec39 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1265 microversion: 2.1 time: 0.203286 May 17 17:15:11.009664 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 330/692] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:10 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:11.936376 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-c3d7d93e-e0dc-488f-94cc-9fb119f707b8 req-160e15ea-3747-4898-b923-6ff1de9b64ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50898191-2e63-45d2-85bb-e47d9fe6d844", "name": "network-vif-plugged", "status": "completed", "tag": "efa762a5-a4d8-4cff-ba5a-528a674014b1"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:11.944737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-c3d7d93e-e0dc-488f-94cc-9fb119f707b8 req-160e15ea-3747-4898-b923-6ff1de9b64ce service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:11.945176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-c3d7d93e-e0dc-488f-94cc-9fb119f707b8 req-160e15ea-3747-4898-b923-6ff1de9b64ce service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:11.956147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-c3d7d93e-e0dc-488f-94cc-9fb119f707b8 req-160e15ea-3747-4898-b923-6ff1de9b64ce service nova] Creating event network-vif-plugged:efa762a5-a4d8-4cff-ba5a-528a674014b1 for instance 50898191-2e63-45d2-85bb-e47d9fe6d844 on hv-cinder-84214 May 17 17:15:11.960848 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-c3d7d93e-e0dc-488f-94cc-9fb119f707b8 req-160e15ea-3747-4898-b923-6ff1de9b64ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028138 May 17 17:15:11.961412 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 363/693] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:15:12.023283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9d49812f-901c-4940-a749-2a59ce183f8c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:12.023992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9d49812f-901c-4940-a749-2a59ce183f8c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:12.028276 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f8faae71-be0f-45ed-b003-760829ab93a0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:12.029182 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f8faae71-be0f-45ed-b003-760829ab93a0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:12.031673 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9d49812f-901c-4940-a749-2a59ce183f8c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:12.032172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9d49812f-901c-4940-a749-2a59ce183f8c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:12.032951 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9d49812f-901c-4940-a749-2a59ce183f8c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:12.033389 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9d49812f-901c-4940-a749-2a59ce183f8c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:12.037438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f8faae71-be0f-45ed-b003-760829ab93a0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:12.037900 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f8faae71-be0f-45ed-b003-760829ab93a0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:12.038671 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f8faae71-be0f-45ed-b003-760829ab93a0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:12.039109 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f8faae71-be0f-45ed-b003-760829ab93a0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:12.243649 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f8faae71-be0f-45ed-b003-760829ab93a0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:12.250376 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9d49812f-901c-4940-a749-2a59ce183f8c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:12.252061 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f8faae71-be0f-45ed-b003-760829ab93a0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1265 microversion: 2.1 time: 0.229062 May 17 17:15:12.253334 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 364/694] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:12 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:12.258414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9d49812f-901c-4940-a749-2a59ce183f8c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1557 microversion: 2.1 time: 0.239283 May 17 17:15:12.258977 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 331/695] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:12 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1557 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:12.275033 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-966e32fa-53ac-4829-8820-121ca459439c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:12.275528 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-966e32fa-53ac-4829-8820-121ca459439c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:12.281599 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-966e32fa-53ac-4829-8820-121ca459439c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:12.282047 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-966e32fa-53ac-4829-8820-121ca459439c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:12.282816 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-966e32fa-53ac-4829-8820-121ca459439c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:12.283249 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-966e32fa-53ac-4829-8820-121ca459439c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:12.360321 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-966e32fa-53ac-4829-8820-121ca459439c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088975 May 17 17:15:12.360914 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 365/696] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 17 17:15:12 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:13.256801 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-40cf3fe5-5568-49ae-8042-a1648d5818fb req-26505e49-28ee-4299-89d8-e78708bc1b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d54d34-bc48-4fdd-8665-f9403cbb8c8f", "tag": "76a127a7-c717-441d-befd-aa3e03f6d0bc"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:13.265424 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-40cf3fe5-5568-49ae-8042-a1648d5818fb req-26505e49-28ee-4299-89d8-e78708bc1b21 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:13.265958 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-40cf3fe5-5568-49ae-8042-a1648d5818fb req-26505e49-28ee-4299-89d8-e78708bc1b21 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:13.269775 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-864c15eb-747a-4ac9-a534-d79c1bb5cc55 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:13.270391 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-864c15eb-747a-4ac9-a534-d79c1bb5cc55 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:13.276570 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-864c15eb-747a-4ac9-a534-d79c1bb5cc55 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:13.277230 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-864c15eb-747a-4ac9-a534-d79c1bb5cc55 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:13.277994 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-864c15eb-747a-4ac9-a534-d79c1bb5cc55 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:13.278408 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-40cf3fe5-5568-49ae-8042-a1648d5818fb req-26505e49-28ee-4299-89d8-e78708bc1b21 service nova] Creating event network-changed:76a127a7-c717-441d-befd-aa3e03f6d0bc for instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f on hv-cinder-84214 May 17 17:15:13.278524 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-864c15eb-747a-4ac9-a534-d79c1bb5cc55 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:13.284829 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-40cf3fe5-5568-49ae-8042-a1648d5818fb req-26505e49-28ee-4299-89d8-e78708bc1b21 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032252 May 17 17:15:13.285656 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 332/697] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:13.416592 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-864c15eb-747a-4ac9-a534-d79c1bb5cc55 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:13.424369 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-864c15eb-747a-4ac9-a534-d79c1bb5cc55 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1265 microversion: 2.1 time: 0.158193 May 17 17:15:13.425227 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 366/698] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:13 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:14.248738 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-44e9dc01-c7c4-4a2f-8ad7-c2a56ac73ae4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:14.250006 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-44e9dc01-c7c4-4a2f-8ad7-c2a56ac73ae4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:14.256959 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-44e9dc01-c7c4-4a2f-8ad7-c2a56ac73ae4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:14.257612 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-44e9dc01-c7c4-4a2f-8ad7-c2a56ac73ae4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:14.258162 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-44e9dc01-c7c4-4a2f-8ad7-c2a56ac73ae4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:14.258819 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-44e9dc01-c7c4-4a2f-8ad7-c2a56ac73ae4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:14.289560 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-44e9dc01-c7c4-4a2f-8ad7-c2a56ac73ae4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044938 May 17 17:15:14.290296 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 333/699] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:15:14 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 17:15:14.350395 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-28882454-ec0a-472b-bfc2-4323bd626a3e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:14.351091 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-28882454-ec0a-472b-bfc2-4323bd626a3e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:14.356998 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-28882454-ec0a-472b-bfc2-4323bd626a3e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:14.357521 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-28882454-ec0a-472b-bfc2-4323bd626a3e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:14.358307 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-28882454-ec0a-472b-bfc2-4323bd626a3e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:14.358787 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-28882454-ec0a-472b-bfc2-4323bd626a3e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:14.389840 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-28882454-ec0a-472b-bfc2-4323bd626a3e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Going to try to terminate instance {{(pid=117090) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:15:14.442352 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-af8b63da-b7e8-4f31-a9d5-a6aa8fea2cea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:14.443314 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-af8b63da-b7e8-4f31-a9d5-a6aa8fea2cea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:14.450977 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-af8b63da-b7e8-4f31-a9d5-a6aa8fea2cea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:14.451436 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-af8b63da-b7e8-4f31-a9d5-a6aa8fea2cea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:14.452248 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-af8b63da-b7e8-4f31-a9d5-a6aa8fea2cea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:14.452689 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-af8b63da-b7e8-4f31-a9d5-a6aa8fea2cea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:14.466384 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-28882454-ec0a-472b-bfc2-4323bd626a3e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 204 len: 0 microversion: 2.1 time: 0.120872 May 17 17:15:14.466999 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 367/700] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:15:14 2022] DELETE /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 17:15:14.476002 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d1dd5a3f-e7f0-495e-9071-f000f43e821e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:14.476701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d1dd5a3f-e7f0-495e-9071-f000f43e821e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:14.482512 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d1dd5a3f-e7f0-495e-9071-f000f43e821e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:14.482963 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d1dd5a3f-e7f0-495e-9071-f000f43e821e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:14.483788 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d1dd5a3f-e7f0-495e-9071-f000f43e821e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:14.484227 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d1dd5a3f-e7f0-495e-9071-f000f43e821e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:14.670261 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-af8b63da-b7e8-4f31-a9d5-a6aa8fea2cea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:14.673417 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d1dd5a3f-e7f0-495e-9071-f000f43e821e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:14.678914 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-af8b63da-b7e8-4f31-a9d5-a6aa8fea2cea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1452 microversion: 2.1 time: 0.241569 May 17 17:15:14.679575 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 334/701] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:14 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1452 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:14.681560 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d1dd5a3f-e7f0-495e-9071-f000f43e821e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1673 microversion: 2.1 time: 0.210214 May 17 17:15:14.682120 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 368/702] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:14 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1673 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:14.695167 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ee94b9f2-e90b-4553-b6a4-7bb36ea0b9ef tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:14.695847 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ee94b9f2-e90b-4553-b6a4-7bb36ea0b9ef tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:14.701592 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ee94b9f2-e90b-4553-b6a4-7bb36ea0b9ef tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:14.702067 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ee94b9f2-e90b-4553-b6a4-7bb36ea0b9ef tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:14.702841 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ee94b9f2-e90b-4553-b6a4-7bb36ea0b9ef tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:14.703259 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ee94b9f2-e90b-4553-b6a4-7bb36ea0b9ef tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:14.829181 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ee94b9f2-e90b-4553-b6a4-7bb36ea0b9ef tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:14.836982 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ee94b9f2-e90b-4553-b6a4-7bb36ea0b9ef tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1452 microversion: 2.1 time: 0.145457 May 17 17:15:14.837541 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 335/703] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:14 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:15.699525 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-48facf37-f042-4363-a980-76c25e278fbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:15.700352 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-48facf37-f042-4363-a980-76c25e278fbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:15.706937 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-48facf37-f042-4363-a980-76c25e278fbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:15.708176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-48facf37-f042-4363-a980-76c25e278fbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:15.708951 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-48facf37-f042-4363-a980-76c25e278fbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:15.709444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-48facf37-f042-4363-a980-76c25e278fbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:15.845167 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-48facf37-f042-4363-a980-76c25e278fbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:15.853830 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-48facf37-f042-4363-a980-76c25e278fbf tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1673 microversion: 2.1 time: 0.158154 May 17 17:15:15.854438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 369/704] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:15 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:16.547309 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-9b5715fe-12d2-4463-a408-3e265620aee0 req-2bdc6190-51b8-4bea-9643-c73d360567e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50898191-2e63-45d2-85bb-e47d9fe6d844", "tag": "efa762a5-a4d8-4cff-ba5a-528a674014b1"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:16.555713 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-9b5715fe-12d2-4463-a408-3e265620aee0 req-2bdc6190-51b8-4bea-9643-c73d360567e2 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:16.556166 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-9b5715fe-12d2-4463-a408-3e265620aee0 req-2bdc6190-51b8-4bea-9643-c73d360567e2 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:16.567561 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-9b5715fe-12d2-4463-a408-3e265620aee0 req-2bdc6190-51b8-4bea-9643-c73d360567e2 service nova] Creating event network-changed:efa762a5-a4d8-4cff-ba5a-528a674014b1 for instance 50898191-2e63-45d2-85bb-e47d9fe6d844 on hv-cinder-84214 May 17 17:15:16.572426 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-9b5715fe-12d2-4463-a408-3e265620aee0 req-2bdc6190-51b8-4bea-9643-c73d360567e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028764 May 17 17:15:16.573020 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 336/705] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:16.871509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ca9ae9aa-be59-447b-9446-abde803e5b25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:16.872912 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ca9ae9aa-be59-447b-9446-abde803e5b25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:16.880865 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca9ae9aa-be59-447b-9446-abde803e5b25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:16.881315 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca9ae9aa-be59-447b-9446-abde803e5b25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:16.882082 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca9ae9aa-be59-447b-9446-abde803e5b25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:16.882796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca9ae9aa-be59-447b-9446-abde803e5b25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:17.023582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ca9ae9aa-be59-447b-9446-abde803e5b25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:17.032378 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ca9ae9aa-be59-447b-9446-abde803e5b25 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1673 microversion: 2.1 time: 0.164721 May 17 17:15:17.035835 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 370/706] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:16 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:17.888837 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6e15e8bf-e168-4b8e-a6a8-55d4fc31fe01 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:17.889419 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6e15e8bf-e168-4b8e-a6a8-55d4fc31fe01 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:17.895790 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6e15e8bf-e168-4b8e-a6a8-55d4fc31fe01 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:17.896248 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6e15e8bf-e168-4b8e-a6a8-55d4fc31fe01 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:17.897023 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6e15e8bf-e168-4b8e-a6a8-55d4fc31fe01 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:17.897694 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6e15e8bf-e168-4b8e-a6a8-55d4fc31fe01 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:17.984059 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-6e15e8bf-e168-4b8e-a6a8-55d4fc31fe01 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lazy-loading 'services' on Instance uuid 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:15:18.052700 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3e29e794-7bda-4463-97e8-2b0de673db95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:18.053922 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-3e29e794-7bda-4463-97e8-2b0de673db95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:18.060726 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3e29e794-7bda-4463-97e8-2b0de673db95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:18.061402 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3e29e794-7bda-4463-97e8-2b0de673db95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:18.062359 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3e29e794-7bda-4463-97e8-2b0de673db95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:18.063115 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3e29e794-7bda-4463-97e8-2b0de673db95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:18.071761 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6e15e8bf-e168-4b8e-a6a8-55d4fc31fe01 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-volume_attachments/b4830ef3-1ab3-4c9c-958c-d8b1178888ff" status: 202 len: 0 microversion: 2.1 time: 0.186423 May 17 17:15:18.075632 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 337/707] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 17 17:15:17 2022] DELETE /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-volume_attachments/b4830ef3-1ab3-4c9c-958c-d8b1178888ff => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:15:18.085401 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-eb766731-af41-430d-a094-e295637c54e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:18.086590 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-eb766731-af41-430d-a094-e295637c54e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:18.094372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eb766731-af41-430d-a094-e295637c54e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:18.094839 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eb766731-af41-430d-a094-e295637c54e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:18.096557 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eb766731-af41-430d-a094-e295637c54e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:18.097038 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eb766731-af41-430d-a094-e295637c54e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:18.186036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-eb766731-af41-430d-a094-e295637c54e4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108821 May 17 17:15:18.186642 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 338/708] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:15:18 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:15:18.197938 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-3e29e794-7bda-4463-97e8-2b0de673db95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:18.208768 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-3e29e794-7bda-4463-97e8-2b0de673db95 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 200 len: 1607 microversion: 2.1 time: 0.162492 May 17 17:15:18.211293 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 371/709] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:18 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 1607 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:18.587468 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-8c1f3204-35f2-42e8-977a-609e57358492 req-31ed81bd-d25e-4140-848e-46341706494c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee2bb8d5-d263-4ab1-8778-77fc4a30f388", "name": "network-vif-deleted", "tag": "a1ea561d-09ff-4ccb-94e1-a73a746f4900"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:18.595427 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-8c1f3204-35f2-42e8-977a-609e57358492 req-31ed81bd-d25e-4140-848e-46341706494c service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:18.596509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-8c1f3204-35f2-42e8-977a-609e57358492 req-31ed81bd-d25e-4140-848e-46341706494c service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:18.607399 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-8c1f3204-35f2-42e8-977a-609e57358492 req-31ed81bd-d25e-4140-848e-46341706494c service nova] Creating event network-vif-deleted:a1ea561d-09ff-4ccb-94e1-a73a746f4900 for instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 on hv-cinder-84214 May 17 17:15:18.613078 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-8c1f3204-35f2-42e8-977a-609e57358492 req-31ed81bd-d25e-4140-848e-46341706494c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029100 May 17 17:15:18.613748 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 339/710] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:19.199035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-37fb6b9f-db6b-45e8-84aa-ec881dee7598 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:19.200048 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-37fb6b9f-db6b-45e8-84aa-ec881dee7598 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:19.206661 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-37fb6b9f-db6b-45e8-84aa-ec881dee7598 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:19.207109 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-37fb6b9f-db6b-45e8-84aa-ec881dee7598 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:19.207907 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-37fb6b9f-db6b-45e8-84aa-ec881dee7598 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:19.208434 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-37fb6b9f-db6b-45e8-84aa-ec881dee7598 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:19.228898 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a7587bcf-131a-403e-9925-291cb84cd1d4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:19.229607 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a7587bcf-131a-403e-9925-291cb84cd1d4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:19.237695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a7587bcf-131a-403e-9925-291cb84cd1d4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:19.238171 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a7587bcf-131a-403e-9925-291cb84cd1d4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:19.239152 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a7587bcf-131a-403e-9925-291cb84cd1d4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:19.239591 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a7587bcf-131a-403e-9925-291cb84cd1d4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:19.240077 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-37fb6b9f-db6b-45e8-84aa-ec881dee7598 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045102 May 17 17:15:19.245081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 372/711] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:15:19 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 17:15:19.254327 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-a7587bcf-131a-403e-9925-291cb84cd1d4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] HTTP exception thrown: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a7587bcf-131a-403e-9925-291cb84cd1d4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Request method failure captured: May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 HTTP/1.1 May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9cJn-DS9kX286yRbLNd5tcZIMkJTirrs1xOw7kMf0sihHBZZGZB1P0YW9qBWvjugFwxy-6F6ljjXWDxpWuYBQJvAUTxpbbFqo5Av1ueTL7XNn_YrlQwfVI9HXyY67PMMHs8YNje0USF5Yn4dCctdGet80pl-r634Kv9wMdm7AgMRBU May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 87f2aabc0cda49538fa0fd9d5db6bf51 May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-AttachVolumeTestJSON-95165178 May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:15:19.256036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:15:19.257572 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:15:19.257572 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-AttachVolumeTestJSON-95165178 May 17 17:15:19.257572 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 87f2aabc0cda49538fa0fd9d5db6bf51 May 17 17:15:19.257572 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-AttachVolumeTestJSON-95165178 May 17 17:15:19.257572 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-AttachVolumeTestJSON-95165178-project May 17 17:15:19.257572 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:15:19.257572 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:15:19.257572 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 74cc0ddf89664a6f92c84ebb9e1ab3a2 May 17 17:15:19.257572 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-AttachVolumeTestJSON-95165178-project May 17 17:15:19.257572 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:15:19.257572 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:15:19.257572 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': 'ee2bb8d5-d263-4ab1-8778-77fc4a30f388'} May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:15:19.258403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:15:19.259981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:19.261219 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a7587bcf-131a-403e-9925-291cb84cd1d4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Returning 404 to user: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:15:19.261219 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a7587bcf-131a-403e-9925-291cb84cd1d4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 404 len: 111 microversion: 2.1 time: 0.034205 May 17 17:15:19.261219 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 340/712] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:19 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 17:15:19.266276 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b4825241-8fa2-4d8d-9670-f6f10f3d3201 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '.version_select at 0x7feb18359310>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:19.284408 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b4825241-8fa2-4d8d-9670-f6f10f3d3201 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-920688059" status: 202 len: 0 microversion: 2.1 time: 0.021621 May 17 17:15:19.285231 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 373/713] 10.222.0.48 () {58 vars in 1217 bytes} [Tue May 17 17:15:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-920688059 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 17:15:19.310694 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8bc69edb-503a-44b3-8878-c7abfb28df65 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:19.311214 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8bc69edb-503a-44b3-8878-c7abfb28df65 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:19.317338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8bc69edb-503a-44b3-8878-c7abfb28df65 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:19.317790 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8bc69edb-503a-44b3-8878-c7abfb28df65 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:19.318554 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8bc69edb-503a-44b3-8878-c7abfb28df65 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:19.318992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8bc69edb-503a-44b3-8878-c7abfb28df65 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:19.344372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8bc69edb-503a-44b3-8878-c7abfb28df65 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Going to try to terminate instance {{(pid=117089) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:15:19.427561 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8bc69edb-503a-44b3-8878-c7abfb28df65 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 204 len: 0 microversion: 2.1 time: 0.120349 May 17 17:15:19.428566 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 341/714] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:15:19 2022] DELETE /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:15:19.436759 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1f1ead8a-3168-47b2-bcb0-7585944ddc73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:19.437609 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1f1ead8a-3168-47b2-bcb0-7585944ddc73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:19.445075 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f1ead8a-3168-47b2-bcb0-7585944ddc73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:19.445561 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f1ead8a-3168-47b2-bcb0-7585944ddc73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:19.446512 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f1ead8a-3168-47b2-bcb0-7585944ddc73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:19.447119 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1f1ead8a-3168-47b2-bcb0-7585944ddc73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:19.589371 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1f1ead8a-3168-47b2-bcb0-7585944ddc73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:19.597482 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1f1ead8a-3168-47b2-bcb0-7585944ddc73 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1689 microversion: 2.1 time: 0.165030 May 17 17:15:19.598053 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 374/715] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:19 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:19.867354 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-eb8c9fd4-ea55-4b39-a001-9af5fd2e7520 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Action: 'create', calling method: .version_select at 0x7feb180a5d30>, body: {"keypair": {"name": "tempest-keypair-116931882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnmaJBTzs95juuwPcn+Un20hqc5rXTdC7xTzalofAsI41fTB5bRoChi5SsqGaZ4S2wuHDRurRpwbynbWWc6s+zjvZbJndeEB5hjBHSOlpmOFMNbEa2muS9EX7qFjloEqw=="}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:19.881290 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-eb8c9fd4-ea55-4b39-a001-9af5fd2e7520 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Getting quotas for project 87f2aabc0cda49538fa0fd9d5db6bf51. Resources: {'key_pairs'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:15:19.885017 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-eb8c9fd4-ea55-4b39-a001-9af5fd2e7520 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Getting quotas for user 74cc0ddf89664a6f92c84ebb9e1ab3a2 and project 87f2aabc0cda49538fa0fd9d5db6bf51. Resources: {'key_pairs'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:15:19.907271 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-eb8c9fd4-ea55-4b39-a001-9af5fd2e7520 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044115 May 17 17:15:19.907925 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 342/716] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 17 17:15:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:15:20.614362 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b58e92fb-ec1a-4ad8-9757-5173d9bf3cf3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:20.614973 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b58e92fb-ec1a-4ad8-9757-5173d9bf3cf3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:20.621279 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b58e92fb-ec1a-4ad8-9757-5173d9bf3cf3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:20.621738 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b58e92fb-ec1a-4ad8-9757-5173d9bf3cf3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:20.622590 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b58e92fb-ec1a-4ad8-9757-5173d9bf3cf3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:20.623073 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b58e92fb-ec1a-4ad8-9757-5173d9bf3cf3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:20.829176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b58e92fb-ec1a-4ad8-9757-5173d9bf3cf3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:20.836853 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b58e92fb-ec1a-4ad8-9757-5173d9bf3cf3 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1689 microversion: 2.1 time: 0.226428 May 17 17:15:20.837466 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 375/717] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:20 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1689 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:21.113969 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1533571285", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1dd4923f-bb48-4a70-ba63-f0b98efd2694"}], "security_groups": [{"name": "tempest-securitygroup--1897246619"}], "key_name": "tempest-keypair-116931882", "user_data": "}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:21.329181 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] validate_networks() for [('1dd4923f-bb48-4a70-ba63-f0b98efd2694', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:15:21.854187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-612d67c2-be55-4dac-acb5-fbb0ae95a4f4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:21.854799 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-612d67c2-be55-4dac-acb5-fbb0ae95a4f4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:21.861787 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-612d67c2-be55-4dac-acb5-fbb0ae95a4f4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:21.862238 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-612d67c2-be55-4dac-acb5-fbb0ae95a4f4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:21.863003 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-612d67c2-be55-4dac-acb5-fbb0ae95a4f4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:21.863435 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-612d67c2-be55-4dac-acb5-fbb0ae95a4f4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:21.898903 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:15:21.899328 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:15:21.899835 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:15:21.900248 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:15:21.900658 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:15:21.909603 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:21.910052 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:21.910853 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:21.911286 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:21.927912 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Getting quotas for project 87f2aabc0cda49538fa0fd9d5db6bf51. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:15:21.931839 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Getting quotas for user 74cc0ddf89664a6f92c84ebb9e1ab3a2 and project 87f2aabc0cda49538fa0fd9d5db6bf51. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:15:21.943533 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:15:21.945986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:15:21.992055 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f8966fed-002f-4336-94d1-5e38ddf7b7a3 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.883031 May 17 17:15:21.992610 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 343/718] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:15:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:15:22.003161 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-612d67c2-be55-4dac-acb5-fbb0ae95a4f4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:22.003479 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6cd5fa47-dd18-4a5a-a59f-27ca47fdaa01 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:22.004173 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6cd5fa47-dd18-4a5a-a59f-27ca47fdaa01 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:22.012003 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-612d67c2-be55-4dac-acb5-fbb0ae95a4f4 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1689 microversion: 2.1 time: 0.161602 May 17 17:15:22.012577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 376/719] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:21 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:22.058809 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6cd5fa47-dd18-4a5a-a59f-27ca47fdaa01 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:22.065932 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6cd5fa47-dd18-4a5a-a59f-27ca47fdaa01 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1237 microversion: 2.1 time: 0.067215 May 17 17:15:22.066498 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 344/720] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:21 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:23.029241 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9086252d-7342-4e16-a3eb-ca1e088a81b9 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:23.029795 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9086252d-7342-4e16-a3eb-ca1e088a81b9 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:23.037315 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9086252d-7342-4e16-a3eb-ca1e088a81b9 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:23.038059 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9086252d-7342-4e16-a3eb-ca1e088a81b9 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:23.039277 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9086252d-7342-4e16-a3eb-ca1e088a81b9 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:23.040035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9086252d-7342-4e16-a3eb-ca1e088a81b9 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:23.082871 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d296e847-e704-4399-93db-4401cdcba94a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:23.083476 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d296e847-e704-4399-93db-4401cdcba94a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:23.089948 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d296e847-e704-4399-93db-4401cdcba94a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:23.090398 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d296e847-e704-4399-93db-4401cdcba94a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:23.091190 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d296e847-e704-4399-93db-4401cdcba94a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:23.091641 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d296e847-e704-4399-93db-4401cdcba94a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:23.175977 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d296e847-e704-4399-93db-4401cdcba94a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:23.183289 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d296e847-e704-4399-93db-4401cdcba94a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1233 microversion: 2.1 time: 0.104188 May 17 17:15:23.184117 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 345/721] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:23 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1233 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:23.213761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9086252d-7342-4e16-a3eb-ca1e088a81b9 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:23.222194 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9086252d-7342-4e16-a3eb-ca1e088a81b9 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1689 microversion: 2.1 time: 0.196611 May 17 17:15:23.223451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 377/722] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:23 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1689 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:24.121125 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-5ccc71c3-263b-45b1-b1e0-e7cdda4dc210 req-0685a8c0-1dc8-4c9b-87f7-532d0b330f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfa0b8b-6981-43aa-9f5c-214bc3c20d64", "name": "network-vif-deleted", "tag": "6b3cb952-d5bd-4de9-965c-39fcdbf9ab21"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:24.148460 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-5ccc71c3-263b-45b1-b1e0-e7cdda4dc210 req-0685a8c0-1dc8-4c9b-87f7-532d0b330f0f service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:24.149526 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-5ccc71c3-263b-45b1-b1e0-e7cdda4dc210 req-0685a8c0-1dc8-4c9b-87f7-532d0b330f0f service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:24.174318 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-5ccc71c3-263b-45b1-b1e0-e7cdda4dc210 req-0685a8c0-1dc8-4c9b-87f7-532d0b330f0f service nova] Creating event network-vif-deleted:6b3cb952-d5bd-4de9-965c-39fcdbf9ab21 for instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 on hv-cinder-84214 May 17 17:15:24.179885 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-5ccc71c3-263b-45b1-b1e0-e7cdda4dc210 req-0685a8c0-1dc8-4c9b-87f7-532d0b330f0f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066085 May 17 17:15:24.181046 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 346/723] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:24.200507 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-750cb520-e359-4574-97d2-6fe560f7798d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:24.201987 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-750cb520-e359-4574-97d2-6fe560f7798d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:24.208822 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-750cb520-e359-4574-97d2-6fe560f7798d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:24.209749 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-750cb520-e359-4574-97d2-6fe560f7798d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:24.210742 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-750cb520-e359-4574-97d2-6fe560f7798d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:24.211432 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-750cb520-e359-4574-97d2-6fe560f7798d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:24.241808 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-5f059711-0735-46f3-832f-dee4becd8c02 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:24.243049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-5f059711-0735-46f3-832f-dee4becd8c02 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:24.255154 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5f059711-0735-46f3-832f-dee4becd8c02 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:24.256097 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5f059711-0735-46f3-832f-dee4becd8c02 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:24.258774 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5f059711-0735-46f3-832f-dee4becd8c02 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:24.259714 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5f059711-0735-46f3-832f-dee4becd8c02 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:24.344654 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-750cb520-e359-4574-97d2-6fe560f7798d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:24.365147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-750cb520-e359-4574-97d2-6fe560f7798d tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1295 microversion: 2.1 time: 0.168071 May 17 17:15:24.370602 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 378/724] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:24 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1295 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:24.404407 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5f059711-0735-46f3-832f-dee4becd8c02 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:24.413232 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-5f059711-0735-46f3-832f-dee4becd8c02 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 200 len: 1329 microversion: 2.1 time: 0.178152 May 17 17:15:24.414260 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 347/725] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:24 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 1329 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:25.386848 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-164fe4bd-34f9-4371-8f72-3eae7ab7bf02 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:25.387887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-164fe4bd-34f9-4371-8f72-3eae7ab7bf02 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:25.396921 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-164fe4bd-34f9-4371-8f72-3eae7ab7bf02 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:25.397557 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-164fe4bd-34f9-4371-8f72-3eae7ab7bf02 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:25.398831 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-164fe4bd-34f9-4371-8f72-3eae7ab7bf02 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:25.399987 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-164fe4bd-34f9-4371-8f72-3eae7ab7bf02 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:25.431498 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d9a2a73d-4b98-42bb-af73-b96bbc6db062 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:25.432299 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d9a2a73d-4b98-42bb-af73-b96bbc6db062 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:25.442413 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d9a2a73d-4b98-42bb-af73-b96bbc6db062 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:25.442966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d9a2a73d-4b98-42bb-af73-b96bbc6db062 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:25.446001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d9a2a73d-4b98-42bb-af73-b96bbc6db062 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:25.446897 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d9a2a73d-4b98-42bb-af73-b96bbc6db062 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:25.475341 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-d9a2a73d-4b98-42bb-af73-b96bbc6db062 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] HTTP exception thrown: Instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 could not be found. May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d9a2a73d-4b98-42bb-af73-b96bbc6db062 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Request method failure captured: May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 HTTP/1.1 May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9cIPlWrQVek_vO5Ab0bf4nYehP1BOWbMBXN-eF9jKvTtM2GSDDAPWJwb8WErqNIdz21bajaEg0P-_qRMTFIo8qTg4RCl1kwggv7oxyH9A5chbw_cqFQQScvlEt6ZZFtWpTXePcbpGZ2EJTY3cBM3VYORCJtl3kWRUuCWHEpw7EGcl4 May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: ea3305a913c541e4a45267497213df1c May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:15:25.477195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:15:25.478878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea3305a913c541e4a45267497213df1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea3305a913c541e4a45267497213df1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea3305a913c541e4a45267497213df1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea3305a913c541e4a45267497213df1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:15:25.478878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:15:25.478878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: ea3305a913c541e4a45267497213df1c May 17 17:15:25.478878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:15:25.478878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-ServerRescueNegativeTestJSON-1349300293-project May 17 17:15:25.478878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:15:25.478878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:15:25.478878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 824915e26a724d938e5dd0a3c1f57932 May 17 17:15:25.478878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349300293-project May 17 17:15:25.478878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:15:25.478878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 could not be found. May 17 17:15:25.478878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': '5bfa0b8b-6981-43aa-9f5c-214bc3c20d64'} May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 could not be found. May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:15:25.479828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 could not be found. May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 could not be found. May 17 17:15:25.481329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:25.483781 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d9a2a73d-4b98-42bb-af73-b96bbc6db062 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Returning 404 to user: Instance 5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:15:25.483781 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d9a2a73d-4b98-42bb-af73-b96bbc6db062 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64" status: 404 len: 111 microversion: 2.1 time: 0.055082 May 17 17:15:25.484441 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 348/726] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:25 2022] GET /compute/v2.1/servers/5bfa0b8b-6981-43aa-9f5c-214bc3c20d64 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:15:25.493063 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e6776b27-60d1-4922-b31c-c50ca76ef368 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '.version_select at 0x7feb1805d280>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:25.521824 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e6776b27-60d1-4922-b31c-c50ca76ef368 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-305926274" status: 202 len: 0 microversion: 2.1 time: 0.032638 May 17 17:15:25.525685 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 349/727] 10.222.0.48 () {58 vars in 1217 bytes} [Tue May 17 17:15:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-305926274 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:15:25.597787 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-164fe4bd-34f9-4371-8f72-3eae7ab7bf02 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:25.605474 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-164fe4bd-34f9-4371-8f72-3eae7ab7bf02 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1363 microversion: 2.1 time: 0.222858 May 17 17:15:25.617021 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 379/728] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:25 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:26.210997 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-2fb08804-af65-40b5-9287-dee464fa6008 req-efa13f07-73c4-4066-9032-9d570cd68118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62871d39-e777-43e3-9d8e-949775d17a50", "tag": "edbc0265-4f57-4250-800f-d5427b10d52d"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:26.219837 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-2fb08804-af65-40b5-9287-dee464fa6008 req-efa13f07-73c4-4066-9032-9d570cd68118 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:26.220227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-2fb08804-af65-40b5-9287-dee464fa6008 req-efa13f07-73c4-4066-9032-9d570cd68118 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:26.231051 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-2fb08804-af65-40b5-9287-dee464fa6008 req-efa13f07-73c4-4066-9032-9d570cd68118 service nova] Creating event network-changed:edbc0265-4f57-4250-800f-d5427b10d52d for instance 62871d39-e777-43e3-9d8e-949775d17a50 on hv-cinder-84214 May 17 17:15:26.236910 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-2fb08804-af65-40b5-9287-dee464fa6008 req-efa13f07-73c4-4066-9032-9d570cd68118 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028708 May 17 17:15:26.237664 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 350/729] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:26.622350 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f9e5f4ae-4445-448b-8cd2-884bf9ccb221 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:26.623026 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f9e5f4ae-4445-448b-8cd2-884bf9ccb221 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:26.629658 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f9e5f4ae-4445-448b-8cd2-884bf9ccb221 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:26.630102 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f9e5f4ae-4445-448b-8cd2-884bf9ccb221 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:26.630853 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f9e5f4ae-4445-448b-8cd2-884bf9ccb221 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:26.631283 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f9e5f4ae-4445-448b-8cd2-884bf9ccb221 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:26.757084 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f9e5f4ae-4445-448b-8cd2-884bf9ccb221 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:26.764690 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f9e5f4ae-4445-448b-8cd2-884bf9ccb221 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1363 microversion: 2.1 time: 0.146160 May 17 17:15:26.765283 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 380/730] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:26 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:27.783688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4aeda45f-7340-453e-abb6-0cf6f79c22b9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:27.784390 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4aeda45f-7340-453e-abb6-0cf6f79c22b9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:27.792516 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4aeda45f-7340-453e-abb6-0cf6f79c22b9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:27.793073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4aeda45f-7340-453e-abb6-0cf6f79c22b9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:27.793841 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4aeda45f-7340-453e-abb6-0cf6f79c22b9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:27.794308 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4aeda45f-7340-453e-abb6-0cf6f79c22b9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:27.923221 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4aeda45f-7340-453e-abb6-0cf6f79c22b9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:27.931180 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4aeda45f-7340-453e-abb6-0cf6f79c22b9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1363 microversion: 2.1 time: 0.152559 May 17 17:15:27.931759 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 351/731] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:27 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:28.501088 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7346d12d-a341-430e-9d5d-ee61657ffb69 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:28.501577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7346d12d-a341-430e-9d5d-ee61657ffb69 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:28.508431 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7346d12d-a341-430e-9d5d-ee61657ffb69 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:28.508879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7346d12d-a341-430e-9d5d-ee61657ffb69 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:28.509637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7346d12d-a341-430e-9d5d-ee61657ffb69 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:28.510068 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7346d12d-a341-430e-9d5d-ee61657ffb69 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:28.534818 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7346d12d-a341-430e-9d5d-ee61657ffb69 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Going to try to terminate instance {{(pid=117090) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:15:28.607805 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7346d12d-a341-430e-9d5d-ee61657ffb69 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "DELETE /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 204 len: 0 microversion: 2.1 time: 0.110133 May 17 17:15:28.608484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 381/732] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:15:28 2022] DELETE /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 17:15:28.616701 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2255114b-a01d-477e-835f-bdd8ebf5b368 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:28.617298 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2255114b-a01d-477e-835f-bdd8ebf5b368 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:28.623205 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2255114b-a01d-477e-835f-bdd8ebf5b368 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:28.623688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2255114b-a01d-477e-835f-bdd8ebf5b368 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:28.624479 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2255114b-a01d-477e-835f-bdd8ebf5b368 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:28.624931 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2255114b-a01d-477e-835f-bdd8ebf5b368 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:28.750822 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2255114b-a01d-477e-835f-bdd8ebf5b368 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:28.758871 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2255114b-a01d-477e-835f-bdd8ebf5b368 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1508 microversion: 2.1 time: 0.146256 May 17 17:15:28.759422 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 352/733] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:28 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:28.949088 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-907dbd2b-0913-4d77-9c2b-db3163947fdd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:28.949792 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-907dbd2b-0913-4d77-9c2b-db3163947fdd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:28.955826 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-907dbd2b-0913-4d77-9c2b-db3163947fdd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:28.956276 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-907dbd2b-0913-4d77-9c2b-db3163947fdd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:28.957039 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-907dbd2b-0913-4d77-9c2b-db3163947fdd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:28.957471 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-907dbd2b-0913-4d77-9c2b-db3163947fdd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:29.085258 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-907dbd2b-0913-4d77-9c2b-db3163947fdd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:29.092565 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-907dbd2b-0913-4d77-9c2b-db3163947fdd tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1363 microversion: 2.1 time: 0.147689 May 17 17:15:29.093131 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 382/734] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:28 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:29.775157 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a3c99dc3-968c-4c91-8c28-b7466b20c4f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:29.775809 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a3c99dc3-968c-4c91-8c28-b7466b20c4f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:29.782588 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a3c99dc3-968c-4c91-8c28-b7466b20c4f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:29.783042 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a3c99dc3-968c-4c91-8c28-b7466b20c4f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:29.783858 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a3c99dc3-968c-4c91-8c28-b7466b20c4f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:29.784292 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a3c99dc3-968c-4c91-8c28-b7466b20c4f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:29.917817 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a3c99dc3-968c-4c91-8c28-b7466b20c4f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:29.925114 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a3c99dc3-968c-4c91-8c28-b7466b20c4f2 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1508 microversion: 2.1 time: 0.153851 May 17 17:15:29.925738 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 353/735] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:29 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:30.109945 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3a512959-a834-4a1f-b953-2f57de5782ab tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:30.110557 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-3a512959-a834-4a1f-b953-2f57de5782ab tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:30.117651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3a512959-a834-4a1f-b953-2f57de5782ab tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:30.118103 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3a512959-a834-4a1f-b953-2f57de5782ab tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:30.118870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3a512959-a834-4a1f-b953-2f57de5782ab tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:30.119305 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3a512959-a834-4a1f-b953-2f57de5782ab tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:30.250138 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-3a512959-a834-4a1f-b953-2f57de5782ab tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:30.257315 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-3a512959-a834-4a1f-b953-2f57de5782ab tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1363 microversion: 2.1 time: 0.151143 May 17 17:15:30.257880 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 383/736] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:30 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:30.942255 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a075e9df-051b-4e97-ab4a-2bf0922b8975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:30.942863 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a075e9df-051b-4e97-ab4a-2bf0922b8975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:30.949280 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a075e9df-051b-4e97-ab4a-2bf0922b8975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:30.949727 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a075e9df-051b-4e97-ab4a-2bf0922b8975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:30.950485 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a075e9df-051b-4e97-ab4a-2bf0922b8975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:30.950946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a075e9df-051b-4e97-ab4a-2bf0922b8975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:31.079781 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a075e9df-051b-4e97-ab4a-2bf0922b8975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:31.087557 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a075e9df-051b-4e97-ab4a-2bf0922b8975 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1508 microversion: 2.1 time: 0.149138 May 17 17:15:31.088143 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 354/737] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:30 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:31.275069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e97abfe7-c1f1-4ed3-bafd-b1c6be970a81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:31.275694 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-e97abfe7-c1f1-4ed3-bafd-b1c6be970a81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:31.282254 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e97abfe7-c1f1-4ed3-bafd-b1c6be970a81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:31.282639 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e97abfe7-c1f1-4ed3-bafd-b1c6be970a81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:31.283388 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e97abfe7-c1f1-4ed3-bafd-b1c6be970a81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:31.283840 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e97abfe7-c1f1-4ed3-bafd-b1c6be970a81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:31.415092 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-e97abfe7-c1f1-4ed3-bafd-b1c6be970a81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:31.422377 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e97abfe7-c1f1-4ed3-bafd-b1c6be970a81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1363 microversion: 2.1 time: 0.151346 May 17 17:15:31.422945 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 384/738] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:31 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:31.701339 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-4d687046-b596-4b93-9b2e-c21dc0038088 req-fe030593-52da-4049-84c0-66dec2f07984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e0001f-f7bc-4b5c-8083-c72723f1d8d4", "name": "network-vif-deleted", "tag": "1efef679-0e58-4dd9-94e3-c4f323122713"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:31.710300 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-4d687046-b596-4b93-9b2e-c21dc0038088 req-fe030593-52da-4049-84c0-66dec2f07984 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:31.710753 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-4d687046-b596-4b93-9b2e-c21dc0038088 req-fe030593-52da-4049-84c0-66dec2f07984 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:31.724563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-4d687046-b596-4b93-9b2e-c21dc0038088 req-fe030593-52da-4049-84c0-66dec2f07984 service nova] Creating event network-vif-deleted:1efef679-0e58-4dd9-94e3-c4f323122713 for instance 58e0001f-f7bc-4b5c-8083-c72723f1d8d4 on hv-cinder-84214 May 17 17:15:31.729756 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-4d687046-b596-4b93-9b2e-c21dc0038088 req-fe030593-52da-4049-84c0-66dec2f07984 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033310 May 17 17:15:31.730568 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 355/739] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:31.891440 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-42072f61-45ea-4581-96d2-07dd803e5972 req-1fa66ab6-7356-4d7f-9158-f44d93ca1f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62871d39-e777-43e3-9d8e-949775d17a50", "name": "network-vif-plugged", "status": "completed", "tag": "edbc0265-4f57-4250-800f-d5427b10d52d"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:31.899946 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-42072f61-45ea-4581-96d2-07dd803e5972 req-1fa66ab6-7356-4d7f-9158-f44d93ca1f5f service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:31.900414 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-42072f61-45ea-4581-96d2-07dd803e5972 req-1fa66ab6-7356-4d7f-9158-f44d93ca1f5f service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:31.913151 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-42072f61-45ea-4581-96d2-07dd803e5972 req-1fa66ab6-7356-4d7f-9158-f44d93ca1f5f service nova] Creating event network-vif-plugged:edbc0265-4f57-4250-800f-d5427b10d52d for instance 62871d39-e777-43e3-9d8e-949775d17a50 on hv-cinder-84214 May 17 17:15:31.917941 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-42072f61-45ea-4581-96d2-07dd803e5972 req-1fa66ab6-7356-4d7f-9158-f44d93ca1f5f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030220 May 17 17:15:31.918539 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 385/740] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:32.106471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1c610b4b-a275-403c-a16b-86ed4ffefa9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:32.110433 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1c610b4b-a275-403c-a16b-86ed4ffefa9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:32.117790 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1c610b4b-a275-403c-a16b-86ed4ffefa9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:32.118315 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1c610b4b-a275-403c-a16b-86ed4ffefa9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:32.119329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1c610b4b-a275-403c-a16b-86ed4ffefa9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:32.119984 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1c610b4b-a275-403c-a16b-86ed4ffefa9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:32.154926 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1c610b4b-a275-403c-a16b-86ed4ffefa9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:32.155761 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1c610b4b-a275-403c-a16b-86ed4ffefa9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:32.156275 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-1c610b4b-a275-403c-a16b-86ed4ffefa9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lazy-loading 'fault' on Instance uuid 58e0001f-f7bc-4b5c-8083-c72723f1d8d4 {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:15:32.199860 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1c610b4b-a275-403c-a16b-86ed4ffefa9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:32.208318 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1c610b4b-a275-403c-a16b-86ed4ffefa9f tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 200 len: 1312 microversion: 2.1 time: 0.107176 May 17 17:15:32.208888 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 356/741] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:32 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:32.441107 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1072b15f-1838-4ad3-944b-d41a7c31c16e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:32.441817 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1072b15f-1838-4ad3-944b-d41a7c31c16e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:32.448085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1072b15f-1838-4ad3-944b-d41a7c31c16e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:32.448528 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1072b15f-1838-4ad3-944b-d41a7c31c16e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:32.449282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1072b15f-1838-4ad3-944b-d41a7c31c16e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:32.449713 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1072b15f-1838-4ad3-944b-d41a7c31c16e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:32.579384 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1072b15f-1838-4ad3-944b-d41a7c31c16e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:32.587196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1072b15f-1838-4ad3-944b-d41a7c31c16e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1363 microversion: 2.1 time: 0.150863 May 17 17:15:32.587787 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 386/742] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:32 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:33.326381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-43d26772-546b-4d98-ba53-84f07dd83ceb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:33.326998 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-43d26772-546b-4d98-ba53-84f07dd83ceb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 58e0001f-f7bc-4b5c-8083-c72723f1d8d4] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:33.333088 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-43d26772-546b-4d98-ba53-84f07dd83ceb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:33.333535 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-43d26772-546b-4d98-ba53-84f07dd83ceb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:33.334314 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-43d26772-546b-4d98-ba53-84f07dd83ceb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:33.334755 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-43d26772-546b-4d98-ba53-84f07dd83ceb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:33.348821 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-43d26772-546b-4d98-ba53-84f07dd83ceb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] HTTP exception thrown: Instance 58e0001f-f7bc-4b5c-8083-c72723f1d8d4 could not be found. May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-43d26772-546b-4d98-ba53-84f07dd83ceb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Request method failure captured: May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 HTTP/1.1 May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9cIPlWrQVek_vO5Ab0bf4nYehP1BOWbMBXN-eF9jKvTtM2GSDDAPWJwb8WErqNIdz21bajaEg0P-_qRMTFIo8qTg4RCl1kwggv7oxyH9A5chbw_cqFQQScvlEt6ZZFtWpTXePcbpGZ2EJTY3cBM3VYORCJtl3kWRUuCWHEpw7EGcl4 May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: ea3305a913c541e4a45267497213df1c May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:15:33.350666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:15:33.352225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea3305a913c541e4a45267497213df1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea3305a913c541e4a45267497213df1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea3305a913c541e4a45267497213df1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea3305a913c541e4a45267497213df1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:15:33.352225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:15:33.352225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: ea3305a913c541e4a45267497213df1c May 17 17:15:33.352225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:15:33.352225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-ServerRescueNegativeTestJSON-1349300293-project May 17 17:15:33.352225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:15:33.352225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:15:33.352225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 824915e26a724d938e5dd0a3c1f57932 May 17 17:15:33.352225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349300293-project May 17 17:15:33.352225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:15:33.352225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance 58e0001f-f7bc-4b5c-8083-c72723f1d8d4 could not be found. May 17 17:15:33.352225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': '58e0001f-f7bc-4b5c-8083-c72723f1d8d4'} May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e0001f-f7bc-4b5c-8083-c72723f1d8d4 could not be found. May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:15:33.352967 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e0001f-f7bc-4b5c-8083-c72723f1d8d4 could not be found. May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e0001f-f7bc-4b5c-8083-c72723f1d8d4 could not be found. May 17 17:15:33.354361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:33.355681 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-43d26772-546b-4d98-ba53-84f07dd83ceb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Returning 404 to user: Instance 58e0001f-f7bc-4b5c-8083-c72723f1d8d4 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:15:33.355681 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-43d26772-546b-4d98-ba53-84f07dd83ceb tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4" status: 404 len: 111 microversion: 2.1 time: 0.131440 May 17 17:15:33.355681 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 357/743] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:33 2022] GET /compute/v2.1/servers/58e0001f-f7bc-4b5c-8083-c72723f1d8d4 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:15:33.360992 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9f123162-d0a9-4eed-98fa-d063a5ad56ea tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:33.361487 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9f123162-d0a9-4eed-98fa-d063a5ad56ea tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:33.368178 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9f123162-d0a9-4eed-98fa-d063a5ad56ea tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:33.368622 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9f123162-d0a9-4eed-98fa-d063a5ad56ea tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:33.369370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9f123162-d0a9-4eed-98fa-d063a5ad56ea tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:33.369799 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9f123162-d0a9-4eed-98fa-d063a5ad56ea tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:33.393419 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9f123162-d0a9-4eed-98fa-d063a5ad56ea tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Going to try to terminate instance {{(pid=117090) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:15:33.468272 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9f123162-d0a9-4eed-98fa-d063a5ad56ea tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "DELETE /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 204 len: 0 microversion: 2.1 time: 0.110621 May 17 17:15:33.468996 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 387/744] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:15:33 2022] DELETE /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:15:33.477812 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-39345df0-1525-40f7-9f29-1448fc88c559 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:33.478490 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-39345df0-1525-40f7-9f29-1448fc88c559 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:33.484906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-39345df0-1525-40f7-9f29-1448fc88c559 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:33.485365 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-39345df0-1525-40f7-9f29-1448fc88c559 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:33.486191 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-39345df0-1525-40f7-9f29-1448fc88c559 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:33.486614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-39345df0-1525-40f7-9f29-1448fc88c559 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:33.604707 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-be71c368-af91-4f43-b421-6bbd951701ff tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:33.605320 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-be71c368-af91-4f43-b421-6bbd951701ff tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:33.611130 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-be71c368-af91-4f43-b421-6bbd951701ff tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:33.611580 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-be71c368-af91-4f43-b421-6bbd951701ff tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:33.612386 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-be71c368-af91-4f43-b421-6bbd951701ff tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:33.612818 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-be71c368-af91-4f43-b421-6bbd951701ff tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:33.613463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-39345df0-1525-40f7-9f29-1448fc88c559 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:33.621583 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-39345df0-1525-40f7-9f29-1448fc88c559 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.147800 May 17 17:15:33.622153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 358/745] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:33 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:33.742660 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-be71c368-af91-4f43-b421-6bbd951701ff tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:33.749824 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-be71c368-af91-4f43-b421-6bbd951701ff tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1363 microversion: 2.1 time: 0.149457 May 17 17:15:33.750392 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 388/746] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:33 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:34.638051 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ed9cf73f-bd1c-4cf4-8ac1-70491eb0dc87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:34.638666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ed9cf73f-bd1c-4cf4-8ac1-70491eb0dc87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:34.645051 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ed9cf73f-bd1c-4cf4-8ac1-70491eb0dc87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:34.645499 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ed9cf73f-bd1c-4cf4-8ac1-70491eb0dc87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:34.646253 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ed9cf73f-bd1c-4cf4-8ac1-70491eb0dc87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:34.646685 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ed9cf73f-bd1c-4cf4-8ac1-70491eb0dc87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:34.771997 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ed9cf73f-bd1c-4cf4-8ac1-70491eb0dc87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:34.779697 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ed9cf73f-bd1c-4cf4-8ac1-70491eb0dc87 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.145388 May 17 17:15:34.780714 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 359/747] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:34 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:34.817854 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a66b1dde-32cf-4f0f-919a-0a2fd684204e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:34.818474 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a66b1dde-32cf-4f0f-919a-0a2fd684204e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:34.824300 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a66b1dde-32cf-4f0f-919a-0a2fd684204e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:34.824747 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a66b1dde-32cf-4f0f-919a-0a2fd684204e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:34.825510 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a66b1dde-32cf-4f0f-919a-0a2fd684204e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:34.825982 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a66b1dde-32cf-4f0f-919a-0a2fd684204e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:34.953045 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a66b1dde-32cf-4f0f-919a-0a2fd684204e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:34.960872 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a66b1dde-32cf-4f0f-919a-0a2fd684204e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1363 microversion: 2.1 time: 0.198422 May 17 17:15:34.961435 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 389/748] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:34 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:35.798157 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3a4cd1c0-ef25-4c1d-ae1d-a37d244c2207 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:35.798775 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3a4cd1c0-ef25-4c1d-ae1d-a37d244c2207 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:35.805857 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a4cd1c0-ef25-4c1d-ae1d-a37d244c2207 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:35.806307 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a4cd1c0-ef25-4c1d-ae1d-a37d244c2207 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:35.807073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a4cd1c0-ef25-4c1d-ae1d-a37d244c2207 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:35.807507 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a4cd1c0-ef25-4c1d-ae1d-a37d244c2207 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:35.936839 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3a4cd1c0-ef25-4c1d-ae1d-a37d244c2207 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:35.944087 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3a4cd1c0-ef25-4c1d-ae1d-a37d244c2207 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.149751 May 17 17:15:35.944643 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 360/749] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:35 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:35.978260 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d810a825-d306-4820-b182-ac995043a9e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:35.978869 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d810a825-d306-4820-b182-ac995043a9e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:35.985297 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d810a825-d306-4820-b182-ac995043a9e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:35.985770 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d810a825-d306-4820-b182-ac995043a9e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:35.986532 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d810a825-d306-4820-b182-ac995043a9e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:35.986966 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d810a825-d306-4820-b182-ac995043a9e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:36.113447 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d810a825-d306-4820-b182-ac995043a9e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:36.120708 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d810a825-d306-4820-b182-ac995043a9e2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1363 microversion: 2.1 time: 0.146233 May 17 17:15:36.121270 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 390/750] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:35 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:36.960601 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ac361005-a0bf-43c1-910a-f74b3cf8ed26 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:36.961311 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ac361005-a0bf-43c1-910a-f74b3cf8ed26 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:36.967711 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ac361005-a0bf-43c1-910a-f74b3cf8ed26 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:36.968175 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ac361005-a0bf-43c1-910a-f74b3cf8ed26 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:36.968948 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ac361005-a0bf-43c1-910a-f74b3cf8ed26 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:36.969386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ac361005-a0bf-43c1-910a-f74b3cf8ed26 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:37.103898 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ac361005-a0bf-43c1-910a-f74b3cf8ed26 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:37.111770 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ac361005-a0bf-43c1-910a-f74b3cf8ed26 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1522 microversion: 2.1 time: 0.154866 May 17 17:15:37.112272 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 361/751] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:36 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:37.137025 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f7b30540-7734-41d9-85d6-0c82a17d9b81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:37.137639 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f7b30540-7734-41d9-85d6-0c82a17d9b81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:37.143974 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f7b30540-7734-41d9-85d6-0c82a17d9b81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:37.144424 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f7b30540-7734-41d9-85d6-0c82a17d9b81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:37.145242 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f7b30540-7734-41d9-85d6-0c82a17d9b81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:37.145674 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f7b30540-7734-41d9-85d6-0c82a17d9b81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:37.272149 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f7b30540-7734-41d9-85d6-0c82a17d9b81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:37.279425 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f7b30540-7734-41d9-85d6-0c82a17d9b81 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1549 microversion: 2.1 time: 0.146441 May 17 17:15:37.280026 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 391/752] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:37 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:37.296453 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b76317e9-a8e6-4192-9015-aae34951df36 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:37.296956 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-b76317e9-a8e6-4192-9015-aae34951df36 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:37.303586 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b76317e9-a8e6-4192-9015-aae34951df36 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:37.304011 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b76317e9-a8e6-4192-9015-aae34951df36 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:37.304785 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b76317e9-a8e6-4192-9015-aae34951df36 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:37.305227 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b76317e9-a8e6-4192-9015-aae34951df36 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:37.379913 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-b76317e9-a8e6-4192-9015-aae34951df36 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087341 May 17 17:15:37.380496 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 362/753] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 17 17:15:37 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:38.129798 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f54012be-bd6d-4197-ad7d-c107a465f242 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:38.130688 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f54012be-bd6d-4197-ad7d-c107a465f242 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:38.137208 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f54012be-bd6d-4197-ad7d-c107a465f242 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:38.137871 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f54012be-bd6d-4197-ad7d-c107a465f242 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:38.138635 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f54012be-bd6d-4197-ad7d-c107a465f242 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:38.139147 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f54012be-bd6d-4197-ad7d-c107a465f242 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:38.231747 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f54012be-bd6d-4197-ad7d-c107a465f242 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '824915e26a724d938e5dd0a3c1f57932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3305a913c541e4a45267497213df1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:38.240379 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f54012be-bd6d-4197-ad7d-c107a465f242 tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 200 len: 1480 microversion: 2.1 time: 0.114704 May 17 17:15:38.241283 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 392/754] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:38 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 1480 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:38.250318 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-3975ca4c-a0eb-46d3-b1ce-e0be00cd615c req-bc851d05-fcd5-43a7-85b9-5aac94ae7ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d096e1-5210-41e8-ae6e-dee03652b474", "name": "network-vif-deleted", "tag": "a023c407-040e-4e16-b8de-6dc1de12fc09"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:38.260113 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-3975ca4c-a0eb-46d3-b1ce-e0be00cd615c req-bc851d05-fcd5-43a7-85b9-5aac94ae7ea3 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:38.260676 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-3975ca4c-a0eb-46d3-b1ce-e0be00cd615c req-bc851d05-fcd5-43a7-85b9-5aac94ae7ea3 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:38.272706 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-3975ca4c-a0eb-46d3-b1ce-e0be00cd615c req-bc851d05-fcd5-43a7-85b9-5aac94ae7ea3 service nova] Creating event network-vif-deleted:a023c407-040e-4e16-b8de-6dc1de12fc09 for instance 09d096e1-5210-41e8-ae6e-dee03652b474 on hv-cinder-84214 May 17 17:15:38.278122 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-3975ca4c-a0eb-46d3-b1ce-e0be00cd615c req-bc851d05-fcd5-43a7-85b9-5aac94ae7ea3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031184 May 17 17:15:38.278726 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 363/755] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:38.339198 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-2ea0ac35-04af-49ed-9271-e32b63f1c1f9 req-e8e6ef02-a39a-4b43-883c-405b3e6919e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62871d39-e777-43e3-9d8e-949775d17a50", "tag": "edbc0265-4f57-4250-800f-d5427b10d52d"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:38.348714 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-2ea0ac35-04af-49ed-9271-e32b63f1c1f9 req-e8e6ef02-a39a-4b43-883c-405b3e6919e5 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:38.349254 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-2ea0ac35-04af-49ed-9271-e32b63f1c1f9 req-e8e6ef02-a39a-4b43-883c-405b3e6919e5 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:38.362279 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-2ea0ac35-04af-49ed-9271-e32b63f1c1f9 req-e8e6ef02-a39a-4b43-883c-405b3e6919e5 service nova] Creating event network-changed:edbc0265-4f57-4250-800f-d5427b10d52d for instance 62871d39-e777-43e3-9d8e-949775d17a50 on hv-cinder-84214 May 17 17:15:38.367634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-2ea0ac35-04af-49ed-9271-e32b63f1c1f9 req-e8e6ef02-a39a-4b43-883c-405b3e6919e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032260 May 17 17:15:38.368262 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 393/756] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:39.257997 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-226f54d6-d3d4-432c-a159-952bb206504b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:39.258700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-226f54d6-d3d4-432c-a159-952bb206504b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] [instance: 09d096e1-5210-41e8-ae6e-dee03652b474] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:39.265279 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-226f54d6-d3d4-432c-a159-952bb206504b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:39.265729 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-226f54d6-d3d4-432c-a159-952bb206504b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:39.266503 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-226f54d6-d3d4-432c-a159-952bb206504b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:39.266942 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-226f54d6-d3d4-432c-a159-952bb206504b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:39.281877 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-226f54d6-d3d4-432c-a159-952bb206504b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] HTTP exception thrown: Instance 09d096e1-5210-41e8-ae6e-dee03652b474 could not be found. May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-226f54d6-d3d4-432c-a159-952bb206504b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Request method failure captured: May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 HTTP/1.1 May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9cIPlWrQVek_vO5Ab0bf4nYehP1BOWbMBXN-eF9jKvTtM2GSDDAPWJwb8WErqNIdz21bajaEg0P-_qRMTFIo8qTg4RCl1kwggv7oxyH9A5chbw_cqFQQScvlEt6ZZFtWpTXePcbpGZ2EJTY3cBM3VYORCJtl3kWRUuCWHEpw7EGcl4 May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: ea3305a913c541e4a45267497213df1c May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:15:39.283501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:15:39.285019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea3305a913c541e4a45267497213df1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea3305a913c541e4a45267497213df1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea3305a913c541e4a45267497213df1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea3305a913c541e4a45267497213df1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:15:39.285019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:15:39.285019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: ea3305a913c541e4a45267497213df1c May 17 17:15:39.285019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349300293 May 17 17:15:39.285019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-ServerRescueNegativeTestJSON-1349300293-project May 17 17:15:39.285019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:15:39.285019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:15:39.285019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 824915e26a724d938e5dd0a3c1f57932 May 17 17:15:39.285019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349300293-project May 17 17:15:39.285019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:15:39.285019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance 09d096e1-5210-41e8-ae6e-dee03652b474 could not be found. May 17 17:15:39.285019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': '09d096e1-5210-41e8-ae6e-dee03652b474'} May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d096e1-5210-41e8-ae6e-dee03652b474 could not be found. May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:15:39.286250 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d096e1-5210-41e8-ae6e-dee03652b474 could not be found. May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d096e1-5210-41e8-ae6e-dee03652b474 could not be found. May 17 17:15:39.287446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:15:39.289588 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-226f54d6-d3d4-432c-a159-952bb206504b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] Returning 404 to user: Instance 09d096e1-5210-41e8-ae6e-dee03652b474 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:15:39.289588 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-226f54d6-d3d4-432c-a159-952bb206504b tempest-ServerRescueNegativeTestJSON-1349300293 tempest-ServerRescueNegativeTestJSON-1349300293-project] 10.222.0.48 "GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474" status: 404 len: 111 microversion: 2.1 time: 0.031199 May 17 17:15:39.289588 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 364/757] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:39 2022] GET /compute/v2.1/servers/09d096e1-5210-41e8-ae6e-dee03652b474 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:15:45.111021 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3101e848-38eb-4bf6-a3e7-8ae3973688f5 tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] Calling method '.version_select at 0x7feb12f210d0>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:45.158826 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-3101e848-38eb-4bf6-a3e7-8ae3973688f5 tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2adc651a-cd8d-48c7-a403-8923b7757b2b" status: 200 len: 350 microversion: 2.1 time: 0.052373 May 17 17:15:45.159393 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 394/758] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:15:45 2022] GET /compute/v2.1/os-volumes/2adc651a-cd8d-48c7-a403-8923b7757b2b => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:46.469430 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-63476850-003d-4f0c-b0b7-57e9aea00f17 tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] Calling method '.version_select at 0x7feb1cab7dc0>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:46.515547 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-63476850-003d-4f0c-b0b7-57e9aea00f17 tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/db122770-27fc-4bf9-9b12-6e8d32a2de8f" status: 200 len: 351 microversion: 2.1 time: 0.049766 May 17 17:15:46.516147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 365/759] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:15:46 2022] GET /compute/v2.1/os-volumes/db122770-27fc-4bf9-9b12-6e8d32a2de8f => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:47.828759 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-246966dc-8f2f-4523-96c4-0b256aec9478 tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] Calling method '.version_select at 0x7feb12f3c0d0>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:47.886737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-246966dc-8f2f-4523-96c4-0b256aec9478 tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b2af3de6-49ed-433d-a46a-7e261b8a4327" status: 200 len: 350 microversion: 2.1 time: 0.062223 May 17 17:15:47.887293 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 395/760] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:15:47 2022] GET /compute/v2.1/os-volumes/b2af3de6-49ed-433d-a46a-7e261b8a4327 => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:47.900877 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7db8cc10-a2fa-426f-a5d4-58b4b264cdfc tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] Calling method '.version_select at 0x7feb137899d0>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:47.980216 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7db8cc10-a2fa-426f-a5d4-58b4b264cdfc tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084504 May 17 17:15:47.980774 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 366/761] 10.222.0.48 () {58 vars in 1133 bytes} [Tue May 17 17:15:47 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:47.992754 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ccdd0fb3-953f-45e7-9e77-ec5b123bcb7f tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] Calling method '.version_select at 0x7feb12f3cb80>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:48.072072 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ccdd0fb3-953f-45e7-9e77-ec5b123bcb7f tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082977 May 17 17:15:48.072641 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 396/762] 10.222.0.48 () {58 vars in 1148 bytes} [Tue May 17 17:15:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:15:48.084513 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-05fa01bb-9551-4a52-a27c-71afc7dc74d4 tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] Calling method '.version_select at 0x7feb180b6790>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:48.167445 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-05fa01bb-9551-4a52-a27c-71afc7dc74d4 tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087149 May 17 17:15:48.168055 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 367/763] 10.222.0.48 () {58 vars in 1133 bytes} [Tue May 17 17:15:48 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:48.182319 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e5de4bc1-cd46-472a-96b4-69dd557968db tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] Calling method '.version_select at 0x7feb12ed0a60>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:48.263490 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e5de4bc1-cd46-472a-96b4-69dd557968db tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087707 May 17 17:15:48.264105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 397/764] 10.222.0.48 () {58 vars in 1166 bytes} [Tue May 17 17:15:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:48.275999 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-909b1ded-214e-4d32-ba0a-72c218501f4f tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] Calling method '.version_select at 0x7feb1805df70>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:48.354696 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-909b1ded-214e-4d32-ba0a-72c218501f4f tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082326 May 17 17:15:48.355259 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 368/765] 10.222.0.48 () {58 vars in 1169 bytes} [Tue May 17 17:15:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:48.367373 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-aa9e6364-b3b3-4cdd-bc3e-e6736360f4e7 tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] Calling method '.version_select at 0x7feb12ee55e0>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:48.447935 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-aa9e6364-b3b3-4cdd-bc3e-e6736360f4e7 tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084394 May 17 17:15:48.448509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 398/766] 10.222.0.48 () {58 vars in 1154 bytes} [Tue May 17 17:15:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:48.460316 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d909ab08-30ea-40ee-8b46-9b5c77e4f9ea tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] Calling method '.version_select at 0x7feb1cab7f70>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:48.538937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d909ab08-30ea-40ee-8b46-9b5c77e4f9ea tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083043 May 17 17:15:48.539498 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 369/767] 10.222.0.48 () {58 vars in 1187 bytes} [Tue May 17 17:15:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:48.550902 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-86ac3a64-5772-4a30-98b3-4c754631feba tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] Calling method '.version_select at 0x7feb12ee5820>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:48.629244 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-86ac3a64-5772-4a30-98b3-4c754631feba tempest-VolumesTestJSON-588058249 tempest-VolumesTestJSON-588058249-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.081487 May 17 17:15:48.630015 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 399/768] 10.222.0.48 () {58 vars in 1154 bytes} [Tue May 17 17:15:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:50.712940 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3b36ea2d-3cc6-46e4-832e-183f52c79109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:50.713439 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3b36ea2d-3cc6-46e4-832e-183f52c79109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:50.719695 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3b36ea2d-3cc6-46e4-832e-183f52c79109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:50.720153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3b36ea2d-3cc6-46e4-832e-183f52c79109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:50.720918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3b36ea2d-3cc6-46e4-832e-183f52c79109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:50.721356 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3b36ea2d-3cc6-46e4-832e-183f52c79109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:50.743386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3b36ea2d-3cc6-46e4-832e-183f52c79109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d/ips" status: 200 len: 153 microversion: 2.20 time: 0.188249 May 17 17:15:50.743960 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 370/769] 10.222.0.48 () {60 vars in 1288 bytes} [Tue May 17 17:15:50 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d/ips => generated 153 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:15:52.816806 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-6df4a26f-465f-4c36-818a-52269eae8972 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:52.817465 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-6df4a26f-465f-4c36-818a-52269eae8972 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:52.823926 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6df4a26f-465f-4c36-818a-52269eae8972 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:52.824454 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6df4a26f-465f-4c36-818a-52269eae8972 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:52.825231 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6df4a26f-465f-4c36-818a-52269eae8972 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:52.825669 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6df4a26f-465f-4c36-818a-52269eae8972 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:52.848570 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-6df4a26f-465f-4c36-818a-52269eae8972 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lazy-loading 'flavor' on Instance uuid b6de88f8-538f-45eb-bfcd-fce744a5c55d {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:15:53.112172 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-6df4a26f-465f-4c36-818a-52269eae8972 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "POST /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d/action" status: 202 len: 0 microversion: 2.20 time: 0.299440 May 17 17:15:53.112938 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 400/770] 10.222.0.48 () {62 vars in 1318 bytes} [Tue May 17 17:15:52 2022] POST /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 17:15:53.121180 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ff8ed102-b162-49dc-b114-7ee8c22424d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:53.122395 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ff8ed102-b162-49dc-b114-7ee8c22424d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:53.135372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff8ed102-b162-49dc-b114-7ee8c22424d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:53.135923 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff8ed102-b162-49dc-b114-7ee8c22424d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:53.137013 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff8ed102-b162-49dc-b114-7ee8c22424d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:53.137727 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff8ed102-b162-49dc-b114-7ee8c22424d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:53.274034 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ff8ed102-b162-49dc-b114-7ee8c22424d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:53.281954 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ff8ed102-b162-49dc-b114-7ee8c22424d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:53.283469 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ff8ed102-b162-49dc-b114-7ee8c22424d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:53.284642 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ff8ed102-b162-49dc-b114-7ee8c22424d2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.167537 May 17 17:15:53.285191 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 371/771] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:15:53 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:15:54.304383 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-51a3568f-f776-42bd-aae4-23da1b8e385d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:54.305076 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-51a3568f-f776-42bd-aae4-23da1b8e385d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:54.312018 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-51a3568f-f776-42bd-aae4-23da1b8e385d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:54.312471 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-51a3568f-f776-42bd-aae4-23da1b8e385d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:54.313239 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-51a3568f-f776-42bd-aae4-23da1b8e385d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:54.313678 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-51a3568f-f776-42bd-aae4-23da1b8e385d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:54.440357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-51a3568f-f776-42bd-aae4-23da1b8e385d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:54.448083 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-51a3568f-f776-42bd-aae4-23da1b8e385d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:54.449582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-51a3568f-f776-42bd-aae4-23da1b8e385d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:54.450723 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-51a3568f-f776-42bd-aae4-23da1b8e385d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.151214 May 17 17:15:54.451283 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 401/772] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:15:54 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:55.469718 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7929849d-cbae-4e2e-95e0-af34af795f33 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:55.470317 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7929849d-cbae-4e2e-95e0-af34af795f33 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:55.485123 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7929849d-cbae-4e2e-95e0-af34af795f33 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:55.485645 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7929849d-cbae-4e2e-95e0-af34af795f33 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:55.486423 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7929849d-cbae-4e2e-95e0-af34af795f33 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:55.486873 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7929849d-cbae-4e2e-95e0-af34af795f33 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:55.616319 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7929849d-cbae-4e2e-95e0-af34af795f33 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:55.623907 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7929849d-cbae-4e2e-95e0-af34af795f33 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:55.625402 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7929849d-cbae-4e2e-95e0-af34af795f33 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:55.626538 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7929849d-cbae-4e2e-95e0-af34af795f33 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.160841 May 17 17:15:55.627095 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 372/773] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:15:55 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:56.091277 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-98d31eb5-e922-44c2-9193-6ab8174c6915 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:56.091894 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-98d31eb5-e922-44c2-9193-6ab8174c6915 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:56.097773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-98d31eb5-e922-44c2-9193-6ab8174c6915 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:56.098270 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-98d31eb5-e922-44c2-9193-6ab8174c6915 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:56.098976 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-98d31eb5-e922-44c2-9193-6ab8174c6915 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:56.099991 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-98d31eb5-e922-44c2-9193-6ab8174c6915 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:56.121664 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-98d31eb5-e922-44c2-9193-6ab8174c6915 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lazy-loading 'flavor' on Instance uuid 47d1426b-07f8-410e-b753-b1d8e9c1102f {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:15:56.193323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-98d31eb5-e922-44c2-9193-6ab8174c6915 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "POST /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f/action" status: 202 len: 0 microversion: 2.1 time: 0.105989 May 17 17:15:56.193918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 402/774] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 17 17:15:56 2022] POST /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:15:56.202114 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4c78203d-e293-4a74-8934-48b8e8ece9d7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:56.202729 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4c78203d-e293-4a74-8934-48b8e8ece9d7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:56.209289 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c78203d-e293-4a74-8934-48b8e8ece9d7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:56.209805 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c78203d-e293-4a74-8934-48b8e8ece9d7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:56.210737 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c78203d-e293-4a74-8934-48b8e8ece9d7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:56.211242 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c78203d-e293-4a74-8934-48b8e8ece9d7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:56.338897 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4c78203d-e293-4a74-8934-48b8e8ece9d7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:56.346252 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4c78203d-e293-4a74-8934-48b8e8ece9d7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.148057 May 17 17:15:56.346813 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 373/775] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:56 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:56.647671 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-06425824-42fb-4f36-969a-03a6647d77d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:56.648609 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-06425824-42fb-4f36-969a-03a6647d77d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:56.656243 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-06425824-42fb-4f36-969a-03a6647d77d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:56.656696 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-06425824-42fb-4f36-969a-03a6647d77d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:56.657481 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-06425824-42fb-4f36-969a-03a6647d77d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:56.658143 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-06425824-42fb-4f36-969a-03a6647d77d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:56.792024 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-06425824-42fb-4f36-969a-03a6647d77d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:56.799757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-06425824-42fb-4f36-969a-03a6647d77d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:56.801255 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-06425824-42fb-4f36-969a-03a6647d77d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:56.802412 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-06425824-42fb-4f36-969a-03a6647d77d9 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.160051 May 17 17:15:56.802977 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 403/776] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:15:56 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:57.363996 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-062139fe-3292-4f4d-9212-0d92c365bb08 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:57.364539 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-062139fe-3292-4f4d-9212-0d92c365bb08 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:57.371061 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-062139fe-3292-4f4d-9212-0d92c365bb08 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:57.371517 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-062139fe-3292-4f4d-9212-0d92c365bb08 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:57.372306 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-062139fe-3292-4f4d-9212-0d92c365bb08 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:57.372749 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-062139fe-3292-4f4d-9212-0d92c365bb08 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:57.502613 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-062139fe-3292-4f4d-9212-0d92c365bb08 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:57.511001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-062139fe-3292-4f4d-9212-0d92c365bb08 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.151025 May 17 17:15:57.511563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 374/777] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:57 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:57.621877 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-421d3ed8-82ce-415c-8f26-f7ea66bababb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:57.622417 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-421d3ed8-82ce-415c-8f26-f7ea66bababb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:57.628767 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-421d3ed8-82ce-415c-8f26-f7ea66bababb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:57.629221 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-421d3ed8-82ce-415c-8f26-f7ea66bababb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:57.630146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-421d3ed8-82ce-415c-8f26-f7ea66bababb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:57.630590 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-421d3ed8-82ce-415c-8f26-f7ea66bababb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:57.662352 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-421d3ed8-82ce-415c-8f26-f7ea66bababb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/ips" status: 200 len: 150 microversion: 2.1 time: 0.044335 May 17 17:15:57.662918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 404/778] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 17 17:15:57 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:57.822460 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9b722e13-6827-428a-a2d4-48aff19f4fea tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:57.823106 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9b722e13-6827-428a-a2d4-48aff19f4fea tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:57.828947 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9b722e13-6827-428a-a2d4-48aff19f4fea tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:57.829426 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9b722e13-6827-428a-a2d4-48aff19f4fea tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:57.830171 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9b722e13-6827-428a-a2d4-48aff19f4fea tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:57.830611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9b722e13-6827-428a-a2d4-48aff19f4fea tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:57.970958 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9b722e13-6827-428a-a2d4-48aff19f4fea tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:57.981634 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9b722e13-6827-428a-a2d4-48aff19f4fea tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:57.983147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9b722e13-6827-428a-a2d4-48aff19f4fea tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:57.984379 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9b722e13-6827-428a-a2d4-48aff19f4fea tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.167929 May 17 17:15:57.984955 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 375/779] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:15:57 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:58.529192 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a67c7a1e-d7c0-4d2b-bd01-fb557f6b6edd tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:58.530056 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a67c7a1e-d7c0-4d2b-bd01-fb557f6b6edd tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:58.536041 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a67c7a1e-d7c0-4d2b-bd01-fb557f6b6edd tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:58.536496 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a67c7a1e-d7c0-4d2b-bd01-fb557f6b6edd tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:58.537258 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a67c7a1e-d7c0-4d2b-bd01-fb557f6b6edd tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:58.538288 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a67c7a1e-d7c0-4d2b-bd01-fb557f6b6edd tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:58.671141 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a67c7a1e-d7c0-4d2b-bd01-fb557f6b6edd tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:58.679628 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a67c7a1e-d7c0-4d2b-bd01-fb557f6b6edd tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.154733 May 17 17:15:58.680196 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 405/780] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:58 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:15:59.004307 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2945ca53-7b22-4541-a1cc-b574b69f486e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:59.004953 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2945ca53-7b22-4541-a1cc-b574b69f486e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:59.011390 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2945ca53-7b22-4541-a1cc-b574b69f486e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:59.011876 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2945ca53-7b22-4541-a1cc-b574b69f486e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:59.012646 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2945ca53-7b22-4541-a1cc-b574b69f486e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:59.013087 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2945ca53-7b22-4541-a1cc-b574b69f486e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:59.139342 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2945ca53-7b22-4541-a1cc-b574b69f486e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:59.147094 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2945ca53-7b22-4541-a1cc-b574b69f486e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:59.149286 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2945ca53-7b22-4541-a1cc-b574b69f486e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:59.150442 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2945ca53-7b22-4541-a1cc-b574b69f486e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.149940 May 17 17:15:59.150995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 376/781] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:15:58 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:59.696784 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c82ef1da-7009-428e-b9f7-411678faf1f8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:59.697376 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c82ef1da-7009-428e-b9f7-411678faf1f8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:15:59.703832 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c82ef1da-7009-428e-b9f7-411678faf1f8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:59.704279 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c82ef1da-7009-428e-b9f7-411678faf1f8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:59.705030 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c82ef1da-7009-428e-b9f7-411678faf1f8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:15:59.705458 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c82ef1da-7009-428e-b9f7-411678faf1f8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:15:59.840775 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c82ef1da-7009-428e-b9f7-411678faf1f8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:15:59.848611 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c82ef1da-7009-428e-b9f7-411678faf1f8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.155739 May 17 17:15:59.849177 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 406/782] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:15:59 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:00.033630 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-336ea4bd-3f2f-40e1-b012-5b6800acbbd7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a318c6fc-771d-41fe-88d8-2fcbc08782e9"}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:00.034939 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-336ea4bd-3f2f-40e1-b012-5b6800acbbd7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:00.041275 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-336ea4bd-3f2f-40e1-b012-5b6800acbbd7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:00.041934 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-336ea4bd-3f2f-40e1-b012-5b6800acbbd7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:00.042787 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-336ea4bd-3f2f-40e1-b012-5b6800acbbd7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:00.043237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-336ea4bd-3f2f-40e1-b012-5b6800acbbd7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:00.169183 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-4bbe8cbb-6a87-4e52-83b4-15b56968adde tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:00.169795 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-4bbe8cbb-6a87-4e52-83b4-15b56968adde tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:00.176403 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4bbe8cbb-6a87-4e52-83b4-15b56968adde tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:00.177192 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4bbe8cbb-6a87-4e52-83b4-15b56968adde tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:00.177989 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4bbe8cbb-6a87-4e52-83b4-15b56968adde tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:00.178424 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4bbe8cbb-6a87-4e52-83b4-15b56968adde tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:00.302736 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-336ea4bd-3f2f-40e1-b012-5b6800acbbd7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "POST /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273112 May 17 17:16:00.303553 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 377/783] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 17 17:16:00 2022] POST /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:00.344263 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-4bbe8cbb-6a87-4e52-83b4-15b56968adde tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:00.352608 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-4bbe8cbb-6a87-4e52-83b4-15b56968adde tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:00.354181 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-4bbe8cbb-6a87-4e52-83b4-15b56968adde tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:00.357231 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-4bbe8cbb-6a87-4e52-83b4-15b56968adde tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.190718 May 17 17:16:00.357926 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 407/784] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:00 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:16:00.867417 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-feb95c54-cbdc-439d-a67a-0b67d482469c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:00.868260 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-feb95c54-cbdc-439d-a67a-0b67d482469c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:00.874418 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-feb95c54-cbdc-439d-a67a-0b67d482469c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:00.874873 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-feb95c54-cbdc-439d-a67a-0b67d482469c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:00.875672 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-feb95c54-cbdc-439d-a67a-0b67d482469c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:00.876112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-feb95c54-cbdc-439d-a67a-0b67d482469c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:01.002772 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-feb95c54-cbdc-439d-a67a-0b67d482469c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:01.010673 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-feb95c54-cbdc-439d-a67a-0b67d482469c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.148052 May 17 17:16:01.011230 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 378/785] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:00 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:01.375882 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-4a0fa795-bebd-45cc-aff8-9030eb80c2e1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:01.376443 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-4a0fa795-bebd-45cc-aff8-9030eb80c2e1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:01.383456 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4a0fa795-bebd-45cc-aff8-9030eb80c2e1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:01.384109 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4a0fa795-bebd-45cc-aff8-9030eb80c2e1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:01.384950 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4a0fa795-bebd-45cc-aff8-9030eb80c2e1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:01.385462 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4a0fa795-bebd-45cc-aff8-9030eb80c2e1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:01.526445 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-4a0fa795-bebd-45cc-aff8-9030eb80c2e1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:01.535339 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-4a0fa795-bebd-45cc-aff8-9030eb80c2e1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:01.537039 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-4a0fa795-bebd-45cc-aff8-9030eb80c2e1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:01.538201 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-4a0fa795-bebd-45cc-aff8-9030eb80c2e1 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.166525 May 17 17:16:01.539406 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 408/786] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:01 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:02.027692 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-c54a268a-5577-4311-b797-a0362cd2db3f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:02.028303 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-c54a268a-5577-4311-b797-a0362cd2db3f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:02.034789 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c54a268a-5577-4311-b797-a0362cd2db3f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:02.035234 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c54a268a-5577-4311-b797-a0362cd2db3f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:02.036029 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c54a268a-5577-4311-b797-a0362cd2db3f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:02.036463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c54a268a-5577-4311-b797-a0362cd2db3f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:02.162177 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-c54a268a-5577-4311-b797-a0362cd2db3f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:02.169560 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-c54a268a-5577-4311-b797-a0362cd2db3f tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.145700 May 17 17:16:02.170109 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 379/787] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:02 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:02.557038 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-644897a0-1b11-4333-939c-cb7e987f7e60 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:02.557649 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-644897a0-1b11-4333-939c-cb7e987f7e60 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:02.564108 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-644897a0-1b11-4333-939c-cb7e987f7e60 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:02.564564 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-644897a0-1b11-4333-939c-cb7e987f7e60 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:02.565336 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-644897a0-1b11-4333-939c-cb7e987f7e60 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:02.565796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-644897a0-1b11-4333-939c-cb7e987f7e60 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:02.700683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-644897a0-1b11-4333-939c-cb7e987f7e60 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:02.708392 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-644897a0-1b11-4333-939c-cb7e987f7e60 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:02.709896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-644897a0-1b11-4333-939c-cb7e987f7e60 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:02.711784 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-644897a0-1b11-4333-939c-cb7e987f7e60 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.158492 May 17 17:16:02.712348 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 409/788] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:02 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:03.186614 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3db0b75e-028b-4896-99ef-2fa2d7d08294 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:03.187159 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3db0b75e-028b-4896-99ef-2fa2d7d08294 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:03.193413 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3db0b75e-028b-4896-99ef-2fa2d7d08294 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:03.193863 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3db0b75e-028b-4896-99ef-2fa2d7d08294 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:03.194678 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3db0b75e-028b-4896-99ef-2fa2d7d08294 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:03.195339 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3db0b75e-028b-4896-99ef-2fa2d7d08294 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:03.327844 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3db0b75e-028b-4896-99ef-2fa2d7d08294 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:03.336352 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3db0b75e-028b-4896-99ef-2fa2d7d08294 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.153109 May 17 17:16:03.336934 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 380/789] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:03 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:03.730063 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ca1c2d17-9fe0-46b8-8237-0663226e842c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:03.730664 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ca1c2d17-9fe0-46b8-8237-0663226e842c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:03.737205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca1c2d17-9fe0-46b8-8237-0663226e842c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:03.737650 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca1c2d17-9fe0-46b8-8237-0663226e842c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:03.738406 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca1c2d17-9fe0-46b8-8237-0663226e842c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:03.738836 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca1c2d17-9fe0-46b8-8237-0663226e842c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:03.914916 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ca1c2d17-9fe0-46b8-8237-0663226e842c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:03.922714 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ca1c2d17-9fe0-46b8-8237-0663226e842c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:03.924240 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ca1c2d17-9fe0-46b8-8237-0663226e842c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:03.925387 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ca1c2d17-9fe0-46b8-8237-0663226e842c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.199286 May 17 17:16:03.925951 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 410/790] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:03 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:04.354306 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3bcc9478-9a43-43e2-9add-026e56a5f379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:04.354952 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3bcc9478-9a43-43e2-9add-026e56a5f379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:04.361162 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3bcc9478-9a43-43e2-9add-026e56a5f379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:04.361608 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3bcc9478-9a43-43e2-9add-026e56a5f379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:04.362381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3bcc9478-9a43-43e2-9add-026e56a5f379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:04.362836 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3bcc9478-9a43-43e2-9add-026e56a5f379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:04.495737 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3bcc9478-9a43-43e2-9add-026e56a5f379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:04.503418 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3bcc9478-9a43-43e2-9add-026e56a5f379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.153474 May 17 17:16:04.504102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 381/791] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:04 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:04.943685 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-edb8003b-973c-42b7-a9d0-328fc22f2abe tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:04.944314 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-edb8003b-973c-42b7-a9d0-328fc22f2abe tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:04.951136 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-edb8003b-973c-42b7-a9d0-328fc22f2abe tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:04.951578 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-edb8003b-973c-42b7-a9d0-328fc22f2abe tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:04.952361 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-edb8003b-973c-42b7-a9d0-328fc22f2abe tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:04.952794 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-edb8003b-973c-42b7-a9d0-328fc22f2abe tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:05.085984 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-edb8003b-973c-42b7-a9d0-328fc22f2abe tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:05.093918 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-edb8003b-973c-42b7-a9d0-328fc22f2abe tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:05.095370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-edb8003b-973c-42b7-a9d0-328fc22f2abe tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:05.096547 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-edb8003b-973c-42b7-a9d0-328fc22f2abe tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.156757 May 17 17:16:05.097101 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 411/792] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:04 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:05.520760 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-bc40f513-3c0a-41a5-958f-3c964179b9eb tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:05.521492 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-bc40f513-3c0a-41a5-958f-3c964179b9eb tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:05.528282 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bc40f513-3c0a-41a5-958f-3c964179b9eb tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:05.529382 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bc40f513-3c0a-41a5-958f-3c964179b9eb tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:05.530262 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bc40f513-3c0a-41a5-958f-3c964179b9eb tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:05.530809 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bc40f513-3c0a-41a5-958f-3c964179b9eb tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:05.669087 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-bc40f513-3c0a-41a5-958f-3c964179b9eb tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:05.684330 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-bc40f513-3c0a-41a5-958f-3c964179b9eb tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.168477 May 17 17:16:05.684899 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 382/793] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:05 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:06.114827 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-4c4b18d3-4bec-4ac4-927b-026bb29d6ced tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:06.115434 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-4c4b18d3-4bec-4ac4-927b-026bb29d6ced tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:06.122506 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4c4b18d3-4bec-4ac4-927b-026bb29d6ced tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:06.122953 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4c4b18d3-4bec-4ac4-927b-026bb29d6ced tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:06.123747 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4c4b18d3-4bec-4ac4-927b-026bb29d6ced tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:06.124182 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4c4b18d3-4bec-4ac4-927b-026bb29d6ced tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:06.251845 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-4c4b18d3-4bec-4ac4-927b-026bb29d6ced tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:06.259785 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-4c4b18d3-4bec-4ac4-927b-026bb29d6ced tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:06.261283 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-4c4b18d3-4bec-4ac4-927b-026bb29d6ced tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:06.262435 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-4c4b18d3-4bec-4ac4-927b-026bb29d6ced tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.151510 May 17 17:16:06.262999 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 412/794] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:06 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:06.701446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7e215f6c-1cd4-4d4e-af77-45d3d9ff0984 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:06.702163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7e215f6c-1cd4-4d4e-af77-45d3d9ff0984 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:06.708560 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e215f6c-1cd4-4d4e-af77-45d3d9ff0984 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:06.709016 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e215f6c-1cd4-4d4e-af77-45d3d9ff0984 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:06.709798 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e215f6c-1cd4-4d4e-af77-45d3d9ff0984 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:06.710883 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e215f6c-1cd4-4d4e-af77-45d3d9ff0984 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:06.861714 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7e215f6c-1cd4-4d4e-af77-45d3d9ff0984 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:06.869965 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7e215f6c-1cd4-4d4e-af77-45d3d9ff0984 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.172292 May 17 17:16:06.870543 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 383/795] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:06 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:07.280787 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c3c3a2bf-c6d4-4033-87e8-3d2ff767a013 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:07.281423 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c3c3a2bf-c6d4-4033-87e8-3d2ff767a013 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:07.287832 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c3c3a2bf-c6d4-4033-87e8-3d2ff767a013 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:07.288931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c3c3a2bf-c6d4-4033-87e8-3d2ff767a013 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:07.289699 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c3c3a2bf-c6d4-4033-87e8-3d2ff767a013 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:07.290134 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c3c3a2bf-c6d4-4033-87e8-3d2ff767a013 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:07.414484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c3c3a2bf-c6d4-4033-87e8-3d2ff767a013 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:07.422257 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c3c3a2bf-c6d4-4033-87e8-3d2ff767a013 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:07.423781 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c3c3a2bf-c6d4-4033-87e8-3d2ff767a013 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:07.424935 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c3c3a2bf-c6d4-4033-87e8-3d2ff767a013 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.148288 May 17 17:16:07.425491 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 413/796] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:07 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:07.790995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f5cc9266-6741-4a31-9a97-757ae5a36100 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a318c6fc-771d-41fe-88d8-2fcbc08782e9"}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:07.792151 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f5cc9266-6741-4a31-9a97-757ae5a36100 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:07.798155 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f5cc9266-6741-4a31-9a97-757ae5a36100 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:07.798600 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f5cc9266-6741-4a31-9a97-757ae5a36100 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:07.799365 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f5cc9266-6741-4a31-9a97-757ae5a36100 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:07.799848 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f5cc9266-6741-4a31-9a97-757ae5a36100 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:07.875589 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-f5cc9266-6741-4a31-9a97-757ae5a36100 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] HTTP exception thrown: Invalid volume: volume a318c6fc-771d-41fe-88d8-2fcbc08782e9 is already attached to instances: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f5cc9266-6741-4a31-9a97-757ae5a36100 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Request method failure captured: May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: POST /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments HTTP/1.1 May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 74 May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9dPWJVb7qwYBnOyu2SibnIHb7br9I07PYlwLrrT_SRrqmmG-Yk2L4b9g7-opL8KlEa-VvVIvtF7WR6pTkYQoWCb_iUMaherr4GYvkZBEx7i_4xoMizUYe3fXvOKjqnKrfi4cSl1B6_TYNoX5UI1IzkedqJD3SKAMFqJ-H9rW400QlM May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:16:07.877372 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:16:07.878986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:16:07.878986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:16:07.878986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:16:07.878986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:16:07.878986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:16:07.878986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:16:07.878986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:16:07.878986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 61daaf70d25c4e1592fcb2f4feafff86 May 17 17:16:07.878986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:16:07.878986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: May 17 17:16:07.878986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {"volumeAttachment": {"volumeId": "a318c6fc-771d-41fe-88d8-2fcbc08782e9"}} May 17 17:16:07.878986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Invalid volume: volume a318c6fc-771d-41fe-88d8-2fcbc08782e9 is already attached to instances: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'server_id': 'c3d54d34-bc48-4fdd-8665-f9403cbb8c8f', 'body': {'volumeAttachment': {'volumeId': 'a318c6fc-771d-41fe-88d8-2fcbc08782e9'}}} May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a318c6fc-771d-41fe-88d8-2fcbc08782e9 is already attached to instances: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:16:07.880049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a318c6fc-771d-41fe-88d8-2fcbc08782e9 is already attached to instances: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:16:07.881367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:16:07.883444 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:16:07.883444 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:16:07.883444 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:16:07.883444 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a318c6fc-771d-41fe-88d8-2fcbc08782e9 is already attached to instances: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f May 17 17:16:07.883444 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:16:07.883444 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f5cc9266-6741-4a31-9a97-757ae5a36100 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Returning 400 to user: Invalid volume: volume a318c6fc-771d-41fe-88d8-2fcbc08782e9 is already attached to instances: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:16:07.883444 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f5cc9266-6741-4a31-9a97-757ae5a36100 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "POST /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092318 May 17 17:16:07.883444 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 384/797] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 17 17:16:07 2022] POST /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 17:16:07.887159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ea510372-f435-42f5-96c5-43a70dad5487 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:07.887810 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ea510372-f435-42f5-96c5-43a70dad5487 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:07.893997 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ea510372-f435-42f5-96c5-43a70dad5487 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:07.894448 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ea510372-f435-42f5-96c5-43a70dad5487 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:07.895208 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ea510372-f435-42f5-96c5-43a70dad5487 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:07.895729 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ea510372-f435-42f5-96c5-43a70dad5487 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:07.939899 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ab9929e8-8cb0-4937-a762-7a1702eb7e6e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:07.940348 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ab9929e8-8cb0-4937-a762-7a1702eb7e6e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:07.946178 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ab9929e8-8cb0-4937-a762-7a1702eb7e6e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:07.946627 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ab9929e8-8cb0-4937-a762-7a1702eb7e6e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:07.947388 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ab9929e8-8cb0-4937-a762-7a1702eb7e6e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:07.947853 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ab9929e8-8cb0-4937-a762-7a1702eb7e6e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:08.026505 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-ab9929e8-8cb0-4937-a762-7a1702eb7e6e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lazy-loading 'services' on Instance uuid c3d54d34-bc48-4fdd-8665-f9403cbb8c8f {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:16:08.028105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ea510372-f435-42f5-96c5-43a70dad5487 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:08.035533 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ea510372-f435-42f5-96c5-43a70dad5487 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.152200 May 17 17:16:08.036124 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 414/798] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:07 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:08.097342 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ab9929e8-8cb0-4937-a762-7a1702eb7e6e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments/a318c6fc-771d-41fe-88d8-2fcbc08782e9" status: 202 len: 0 microversion: 2.1 time: 0.161255 May 17 17:16:08.097918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 385/799] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 17 17:16:07 2022] DELETE /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments/a318c6fc-771d-41fe-88d8-2fcbc08782e9 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 17:16:08.107077 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f4c10659-cb07-49df-92d8-f2602db921c5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:08.108167 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f4c10659-cb07-49df-92d8-f2602db921c5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:08.114079 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f4c10659-cb07-49df-92d8-f2602db921c5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:08.114600 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f4c10659-cb07-49df-92d8-f2602db921c5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:08.115556 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f4c10659-cb07-49df-92d8-f2602db921c5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:08.116011 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f4c10659-cb07-49df-92d8-f2602db921c5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:08.146671 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f4c10659-cb07-49df-92d8-f2602db921c5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043429 May 17 17:16:08.147232 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 415/800] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:16:08 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:08.443576 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ddcbf163-4c2a-4777-b41b-ad1297220b8a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:08.444881 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ddcbf163-4c2a-4777-b41b-ad1297220b8a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:08.451295 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ddcbf163-4c2a-4777-b41b-ad1297220b8a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:08.451780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ddcbf163-4c2a-4777-b41b-ad1297220b8a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:08.452553 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ddcbf163-4c2a-4777-b41b-ad1297220b8a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:08.452998 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ddcbf163-4c2a-4777-b41b-ad1297220b8a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:08.578065 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ddcbf163-4c2a-4777-b41b-ad1297220b8a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:08.585796 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ddcbf163-4c2a-4777-b41b-ad1297220b8a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:08.587298 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ddcbf163-4c2a-4777-b41b-ad1297220b8a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:08.588476 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ddcbf163-4c2a-4777-b41b-ad1297220b8a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.149277 May 17 17:16:08.589032 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 386/801] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:08 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:09.053085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2750ba6d-5bac-4851-98b6-70c3046d4d67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:09.053698 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2750ba6d-5bac-4851-98b6-70c3046d4d67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:09.060066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2750ba6d-5bac-4851-98b6-70c3046d4d67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:09.060511 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2750ba6d-5bac-4851-98b6-70c3046d4d67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:09.061263 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2750ba6d-5bac-4851-98b6-70c3046d4d67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:09.061695 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2750ba6d-5bac-4851-98b6-70c3046d4d67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:09.158580 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ff73834d-0f7e-4e2c-a2b2-1f0d17cdb0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:09.159574 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ff73834d-0f7e-4e2c-a2b2-1f0d17cdb0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:09.165838 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff73834d-0f7e-4e2c-a2b2-1f0d17cdb0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:09.166291 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff73834d-0f7e-4e2c-a2b2-1f0d17cdb0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:09.167062 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff73834d-0f7e-4e2c-a2b2-1f0d17cdb0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:09.167530 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff73834d-0f7e-4e2c-a2b2-1f0d17cdb0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:09.194919 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2750ba6d-5bac-4851-98b6-70c3046d4d67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:09.196826 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ff73834d-0f7e-4e2c-a2b2-1f0d17cdb0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042348 May 17 17:16:09.197398 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 387/802] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:16:09 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:16:09.202458 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2750ba6d-5bac-4851-98b6-70c3046d4d67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.153170 May 17 17:16:09.203026 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 416/803] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:09 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:09.606149 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-5456fa7c-ee7b-4c46-b0c5-647c392320d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:09.606870 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-5456fa7c-ee7b-4c46-b0c5-647c392320d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:09.613044 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5456fa7c-ee7b-4c46-b0c5-647c392320d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:09.613494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5456fa7c-ee7b-4c46-b0c5-647c392320d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:09.614288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5456fa7c-ee7b-4c46-b0c5-647c392320d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:09.614725 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5456fa7c-ee7b-4c46-b0c5-647c392320d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:09.741814 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5456fa7c-ee7b-4c46-b0c5-647c392320d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:09.750112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5456fa7c-ee7b-4c46-b0c5-647c392320d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:09.751634 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5456fa7c-ee7b-4c46-b0c5-647c392320d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:09.752798 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-5456fa7c-ee7b-4c46-b0c5-647c392320d4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.150477 May 17 17:16:09.753379 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 388/804] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:09 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:10.208137 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2fb8b019-7622-48f3-a796-6c065327d887 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:10.209148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2fb8b019-7622-48f3-a796-6c065327d887 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:10.219578 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2b31a29f-e982-4433-91e9-45f050d71e21 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:10.220270 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2b31a29f-e982-4433-91e9-45f050d71e21 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:10.223956 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2fb8b019-7622-48f3-a796-6c065327d887 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:10.224413 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2fb8b019-7622-48f3-a796-6c065327d887 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:10.225186 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2fb8b019-7622-48f3-a796-6c065327d887 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:10.228078 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2fb8b019-7622-48f3-a796-6c065327d887 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:10.234185 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2b31a29f-e982-4433-91e9-45f050d71e21 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:10.234667 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2b31a29f-e982-4433-91e9-45f050d71e21 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:10.235831 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2b31a29f-e982-4433-91e9-45f050d71e21 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:10.236266 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2b31a29f-e982-4433-91e9-45f050d71e21 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:10.263910 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2fb8b019-7622-48f3-a796-6c065327d887 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059748 May 17 17:16:10.264534 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 417/805] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:16:10 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:10.370324 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2b31a29f-e982-4433-91e9-45f050d71e21 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:10.377773 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2b31a29f-e982-4433-91e9-45f050d71e21 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.162494 May 17 17:16:10.378337 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 389/806] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:10 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:16:10.771498 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b37b8586-3bd8-4531-aba1-40b8fc546f6e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:10.772146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b37b8586-3bd8-4531-aba1-40b8fc546f6e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:10.778774 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b37b8586-3bd8-4531-aba1-40b8fc546f6e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:10.779492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b37b8586-3bd8-4531-aba1-40b8fc546f6e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:10.780283 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b37b8586-3bd8-4531-aba1-40b8fc546f6e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:10.780721 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b37b8586-3bd8-4531-aba1-40b8fc546f6e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:10.905767 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b37b8586-3bd8-4531-aba1-40b8fc546f6e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:10.913769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b37b8586-3bd8-4531-aba1-40b8fc546f6e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:10.915252 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b37b8586-3bd8-4531-aba1-40b8fc546f6e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:10.916450 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b37b8586-3bd8-4531-aba1-40b8fc546f6e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1746 microversion: 2.20 time: 0.148829 May 17 17:16:10.917006 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 418/807] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:10 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:11.276254 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-944e03f4-d5d9-4266-af35-07ad3155d3ee tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:11.277289 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-944e03f4-d5d9-4266-af35-07ad3155d3ee tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:11.283925 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-944e03f4-d5d9-4266-af35-07ad3155d3ee tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:11.284378 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-944e03f4-d5d9-4266-af35-07ad3155d3ee tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:11.285140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-944e03f4-d5d9-4266-af35-07ad3155d3ee tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:11.285574 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-944e03f4-d5d9-4266-af35-07ad3155d3ee tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:11.316116 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-944e03f4-d5d9-4266-af35-07ad3155d3ee tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044438 May 17 17:16:11.316668 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 390/808] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:16:11 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:11.395011 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-fcaeb970-14ab-443e-9e71-47f0cdc38517 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:11.395558 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-fcaeb970-14ab-443e-9e71-47f0cdc38517 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:11.402967 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fcaeb970-14ab-443e-9e71-47f0cdc38517 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:11.403421 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fcaeb970-14ab-443e-9e71-47f0cdc38517 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:11.404509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fcaeb970-14ab-443e-9e71-47f0cdc38517 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:11.404946 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fcaeb970-14ab-443e-9e71-47f0cdc38517 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:11.532356 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-fcaeb970-14ab-443e-9e71-47f0cdc38517 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:11.539858 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-fcaeb970-14ab-443e-9e71-47f0cdc38517 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.148403 May 17 17:16:11.540574 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 419/809] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:11 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:11.935767 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2670293e-30f4-4e07-af3d-ff517cedf3ee tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:11.936376 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2670293e-30f4-4e07-af3d-ff517cedf3ee tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:11.942293 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2670293e-30f4-4e07-af3d-ff517cedf3ee tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:11.942747 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2670293e-30f4-4e07-af3d-ff517cedf3ee tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:11.943508 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2670293e-30f4-4e07-af3d-ff517cedf3ee tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:11.943972 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2670293e-30f4-4e07-af3d-ff517cedf3ee tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:12.072335 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2670293e-30f4-4e07-af3d-ff517cedf3ee tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:12.080264 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2670293e-30f4-4e07-af3d-ff517cedf3ee tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:12.081774 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2670293e-30f4-4e07-af3d-ff517cedf3ee tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:12.082939 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2670293e-30f4-4e07-af3d-ff517cedf3ee tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1746 microversion: 2.20 time: 0.151066 May 17 17:16:12.083497 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 391/810] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:11 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:12.327568 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-99d716c9-e7a4-4367-9c72-db738a698ed4 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:12.328536 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-99d716c9-e7a4-4367-9c72-db738a698ed4 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:12.334421 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99d716c9-e7a4-4367-9c72-db738a698ed4 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:12.334872 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99d716c9-e7a4-4367-9c72-db738a698ed4 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:12.335667 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99d716c9-e7a4-4367-9c72-db738a698ed4 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:12.336197 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-99d716c9-e7a4-4367-9c72-db738a698ed4 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:12.365546 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-99d716c9-e7a4-4367-9c72-db738a698ed4 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041877 May 17 17:16:12.366102 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 420/811] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:16:12 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:12.557609 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9e342d89-8372-4d11-a37c-7fb40ae52b8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:12.558220 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9e342d89-8372-4d11-a37c-7fb40ae52b8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:12.564704 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9e342d89-8372-4d11-a37c-7fb40ae52b8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:12.565157 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9e342d89-8372-4d11-a37c-7fb40ae52b8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:12.565917 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9e342d89-8372-4d11-a37c-7fb40ae52b8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:12.566355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9e342d89-8372-4d11-a37c-7fb40ae52b8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:12.694029 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9e342d89-8372-4d11-a37c-7fb40ae52b8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:12.702065 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9e342d89-8372-4d11-a37c-7fb40ae52b8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.149060 May 17 17:16:12.702633 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 392/812] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:12 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:13.108177 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c0ca9519-1c61-47d8-9700-e2c54fb352e7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:13.108781 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c0ca9519-1c61-47d8-9700-e2c54fb352e7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:13.115083 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c0ca9519-1c61-47d8-9700-e2c54fb352e7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:13.115529 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c0ca9519-1c61-47d8-9700-e2c54fb352e7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:13.116310 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c0ca9519-1c61-47d8-9700-e2c54fb352e7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:13.116738 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c0ca9519-1c61-47d8-9700-e2c54fb352e7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:13.244935 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c0ca9519-1c61-47d8-9700-e2c54fb352e7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:13.252786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c0ca9519-1c61-47d8-9700-e2c54fb352e7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:13.254283 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c0ca9519-1c61-47d8-9700-e2c54fb352e7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:13.255449 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c0ca9519-1c61-47d8-9700-e2c54fb352e7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1746 microversion: 2.20 time: 0.151148 May 17 17:16:13.256049 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 421/813] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:13 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:13.377860 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3c0541da-639a-4f55-abff-e942d9b63ee1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:13.378708 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3c0541da-639a-4f55-abff-e942d9b63ee1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:13.384714 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3c0541da-639a-4f55-abff-e942d9b63ee1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:13.385166 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3c0541da-639a-4f55-abff-e942d9b63ee1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:13.385926 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3c0541da-639a-4f55-abff-e942d9b63ee1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:13.386362 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3c0541da-639a-4f55-abff-e942d9b63ee1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:13.414554 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3c0541da-639a-4f55-abff-e942d9b63ee1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040724 May 17 17:16:13.415088 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 393/814] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:16:13 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:13.719979 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-93f805bc-2c5d-44a3-9afe-6dbaae295ad7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:13.720504 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-93f805bc-2c5d-44a3-9afe-6dbaae295ad7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:13.726389 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-93f805bc-2c5d-44a3-9afe-6dbaae295ad7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:13.726840 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-93f805bc-2c5d-44a3-9afe-6dbaae295ad7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:13.727589 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-93f805bc-2c5d-44a3-9afe-6dbaae295ad7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:13.728043 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-93f805bc-2c5d-44a3-9afe-6dbaae295ad7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:13.856749 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-93f805bc-2c5d-44a3-9afe-6dbaae295ad7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:13.864020 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-93f805bc-2c5d-44a3-9afe-6dbaae295ad7 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.147980 May 17 17:16:13.864581 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 422/815] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:13 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:14.273265 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4a1d76f6-beb8-4146-b19c-161971bc0cbf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:14.273828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4a1d76f6-beb8-4146-b19c-161971bc0cbf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:14.280752 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4a1d76f6-beb8-4146-b19c-161971bc0cbf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:14.281204 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4a1d76f6-beb8-4146-b19c-161971bc0cbf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:14.281968 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4a1d76f6-beb8-4146-b19c-161971bc0cbf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:14.282405 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4a1d76f6-beb8-4146-b19c-161971bc0cbf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:14.426804 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-68e469d1-733c-4212-b71c-942267baa728 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:14.427759 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-68e469d1-733c-4212-b71c-942267baa728 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:14.434663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-68e469d1-733c-4212-b71c-942267baa728 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:14.435331 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-68e469d1-733c-4212-b71c-942267baa728 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:14.439692 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-68e469d1-733c-4212-b71c-942267baa728 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:14.439692 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-68e469d1-733c-4212-b71c-942267baa728 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:14.482627 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-68e469d1-733c-4212-b71c-942267baa728 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059683 May 17 17:16:14.483527 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 423/816] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:16:14 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:16:14.496535 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4a1d76f6-beb8-4146-b19c-161971bc0cbf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:14.505831 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4a1d76f6-beb8-4146-b19c-161971bc0cbf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:14.507317 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4a1d76f6-beb8-4146-b19c-161971bc0cbf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:14.508517 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4a1d76f6-beb8-4146-b19c-161971bc0cbf tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1746 microversion: 2.20 time: 0.239249 May 17 17:16:14.509088 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 394/817] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:14 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1746 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:14.881068 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-c07ccbfe-c31d-4aef-9f24-1f197e7ae5ae tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:14.881791 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-c07ccbfe-c31d-4aef-9f24-1f197e7ae5ae tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:14.888430 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c07ccbfe-c31d-4aef-9f24-1f197e7ae5ae tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:14.888778 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c07ccbfe-c31d-4aef-9f24-1f197e7ae5ae tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:14.889536 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c07ccbfe-c31d-4aef-9f24-1f197e7ae5ae tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:14.889962 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-c07ccbfe-c31d-4aef-9f24-1f197e7ae5ae tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:15.043582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-c07ccbfe-c31d-4aef-9f24-1f197e7ae5ae tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:15.051656 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-c07ccbfe-c31d-4aef-9f24-1f197e7ae5ae tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.174352 May 17 17:16:15.052340 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 424/818] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:14 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:15.494591 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b06d6885-9b1e-4c0f-a149-7323a6508dc1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:15.495636 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-b06d6885-9b1e-4c0f-a149-7323a6508dc1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:15.502394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b06d6885-9b1e-4c0f-a149-7323a6508dc1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:15.503090 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b06d6885-9b1e-4c0f-a149-7323a6508dc1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:15.503966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b06d6885-9b1e-4c0f-a149-7323a6508dc1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:15.504627 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b06d6885-9b1e-4c0f-a149-7323a6508dc1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:15.532865 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9ea1cd33-36fa-44e1-b923-71594a771199 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:15.534183 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9ea1cd33-36fa-44e1-b923-71594a771199 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:15.541011 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-b06d6885-9b1e-4c0f-a149-7323a6508dc1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049908 May 17 17:16:15.544098 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 395/819] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:16:15 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 17:16:15.546925 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9ea1cd33-36fa-44e1-b923-71594a771199 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:15.547498 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9ea1cd33-36fa-44e1-b923-71594a771199 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:15.548437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9ea1cd33-36fa-44e1-b923-71594a771199 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:15.551513 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9ea1cd33-36fa-44e1-b923-71594a771199 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:15.621292 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e0b471fc-d5b6-479a-8b16-cef08cca67d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:15.622097 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e0b471fc-d5b6-479a-8b16-cef08cca67d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:15.629462 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e0b471fc-d5b6-479a-8b16-cef08cca67d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:15.629912 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e0b471fc-d5b6-479a-8b16-cef08cca67d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:15.630685 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e0b471fc-d5b6-479a-8b16-cef08cca67d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:15.631118 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e0b471fc-d5b6-479a-8b16-cef08cca67d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:15.669831 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e0b471fc-d5b6-479a-8b16-cef08cca67d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Going to try to terminate instance {{(pid=117089) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:16:15.765626 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9ea1cd33-36fa-44e1-b923-71594a771199 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:15.776831 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9ea1cd33-36fa-44e1-b923-71594a771199 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:15.779146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9ea1cd33-36fa-44e1-b923-71594a771199 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:15.782170 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9ea1cd33-36fa-44e1-b923-71594a771199 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1741 microversion: 2.20 time: 0.254619 May 17 17:16:15.796445 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 425/820] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:15 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1741 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:16:15.819204 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e0b471fc-d5b6-479a-8b16-cef08cca67d1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 204 len: 0 microversion: 2.1 time: 0.201176 May 17 17:16:15.821155 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 396/821] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:16:15 2022] DELETE /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 17:16:15.831366 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-0676d0ed-88f4-4f39-b63b-410a62840eac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:15.832362 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-0676d0ed-88f4-4f39-b63b-410a62840eac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:15.843481 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0676d0ed-88f4-4f39-b63b-410a62840eac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:15.844107 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0676d0ed-88f4-4f39-b63b-410a62840eac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:15.845188 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0676d0ed-88f4-4f39-b63b-410a62840eac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:15.845734 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0676d0ed-88f4-4f39-b63b-410a62840eac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:16.063280 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-0676d0ed-88f4-4f39-b63b-410a62840eac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:16.068620 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-be4cdfff-67a1-4ba3-bf78-f6e4a2a2208c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:16.069983 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-be4cdfff-67a1-4ba3-bf78-f6e4a2a2208c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:16.071016 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-0676d0ed-88f4-4f39-b63b-410a62840eac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1682 microversion: 2.1 time: 0.245092 May 17 17:16:16.072454 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 426/822] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:15 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1682 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:16:16.082092 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-be4cdfff-67a1-4ba3-bf78-f6e4a2a2208c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:16.082092 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-be4cdfff-67a1-4ba3-bf78-f6e4a2a2208c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:16.082092 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-be4cdfff-67a1-4ba3-bf78-f6e4a2a2208c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:16.082092 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-be4cdfff-67a1-4ba3-bf78-f6e4a2a2208c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:16.246584 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-be4cdfff-67a1-4ba3-bf78-f6e4a2a2208c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:16.256327 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-be4cdfff-67a1-4ba3-bf78-f6e4a2a2208c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.191742 May 17 17:16:16.257400 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 397/823] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:16 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:16:16.296570 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-2f5b0539-a905-4f1e-bf53-b3da8da24c9f req-706f6dc1-0f35-4256-b079-d05097de1827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6de88f8-538f-45eb-bfcd-fce744a5c55d", "name": "network-vif-plugged", "status": "completed", "tag": "e349ab19-ab43-4bf5-8128-4ce8f8b7a5f5"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:16.304959 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-2f5b0539-a905-4f1e-bf53-b3da8da24c9f req-706f6dc1-0f35-4256-b079-d05097de1827 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:16.305487 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-2f5b0539-a905-4f1e-bf53-b3da8da24c9f req-706f6dc1-0f35-4256-b079-d05097de1827 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:16.318432 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-2f5b0539-a905-4f1e-bf53-b3da8da24c9f req-706f6dc1-0f35-4256-b079-d05097de1827 service nova] Creating event network-vif-plugged:e349ab19-ab43-4bf5-8128-4ce8f8b7a5f5 for instance b6de88f8-538f-45eb-bfcd-fce744a5c55d on hv-cinder-84214 May 17 17:16:16.324273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-2f5b0539-a905-4f1e-bf53-b3da8da24c9f req-706f6dc1-0f35-4256-b079-d05097de1827 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195278 May 17 17:16:16.324953 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 427/824] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:16:16.802350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-beb7ad14-ed9f-4eb9-a654-4b3fdcd031aa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:16.803586 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-beb7ad14-ed9f-4eb9-a654-4b3fdcd031aa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:16.810642 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-beb7ad14-ed9f-4eb9-a654-4b3fdcd031aa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:16.811095 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-beb7ad14-ed9f-4eb9-a654-4b3fdcd031aa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:16.812082 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-beb7ad14-ed9f-4eb9-a654-4b3fdcd031aa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:16.812692 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-beb7ad14-ed9f-4eb9-a654-4b3fdcd031aa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:16.953533 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-beb7ad14-ed9f-4eb9-a654-4b3fdcd031aa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:16.963301 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-beb7ad14-ed9f-4eb9-a654-4b3fdcd031aa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:16.965082 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-beb7ad14-ed9f-4eb9-a654-4b3fdcd031aa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:16.966511 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-beb7ad14-ed9f-4eb9-a654-4b3fdcd031aa tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1741 microversion: 2.20 time: 0.168078 May 17 17:16:16.977817 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 398/825] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:16 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:17.091364 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e9735737-b89f-4bcb-8a12-b478d3ebbc99 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:17.092841 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-e9735737-b89f-4bcb-8a12-b478d3ebbc99 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:17.100541 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e9735737-b89f-4bcb-8a12-b478d3ebbc99 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:17.101120 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e9735737-b89f-4bcb-8a12-b478d3ebbc99 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:17.101981 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e9735737-b89f-4bcb-8a12-b478d3ebbc99 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:17.102501 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e9735737-b89f-4bcb-8a12-b478d3ebbc99 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:17.269951 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-e9735737-b89f-4bcb-8a12-b478d3ebbc99 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:17.273842 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a7857519-84a4-4f3a-a8ad-e455bedf05fe tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:17.275538 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a7857519-84a4-4f3a-a8ad-e455bedf05fe tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:17.281742 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e9735737-b89f-4bcb-8a12-b478d3ebbc99 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1682 microversion: 2.1 time: 0.195706 May 17 17:16:17.284856 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 428/826] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:17 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1682 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:17.287898 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a7857519-84a4-4f3a-a8ad-e455bedf05fe tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:17.288939 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a7857519-84a4-4f3a-a8ad-e455bedf05fe tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:17.289932 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a7857519-84a4-4f3a-a8ad-e455bedf05fe tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:17.290594 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a7857519-84a4-4f3a-a8ad-e455bedf05fe tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:17.442314 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a7857519-84a4-4f3a-a8ad-e455bedf05fe tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:17.452688 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a7857519-84a4-4f3a-a8ad-e455bedf05fe tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.182621 May 17 17:16:17.453262 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 399/827] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:17 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:17.985308 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2869d5a1-c5cf-48e7-a6a2-765307314937 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:17.985911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2869d5a1-c5cf-48e7-a6a2-765307314937 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:17.993265 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2869d5a1-c5cf-48e7-a6a2-765307314937 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:17.994141 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2869d5a1-c5cf-48e7-a6a2-765307314937 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:17.996110 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2869d5a1-c5cf-48e7-a6a2-765307314937 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:17.996631 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2869d5a1-c5cf-48e7-a6a2-765307314937 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:18.156486 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2869d5a1-c5cf-48e7-a6a2-765307314937 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:18.164326 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2869d5a1-c5cf-48e7-a6a2-765307314937 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:18.169861 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2869d5a1-c5cf-48e7-a6a2-765307314937 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:18.170667 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2869d5a1-c5cf-48e7-a6a2-765307314937 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1741 microversion: 2.20 time: 0.189300 May 17 17:16:18.171576 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 429/828] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:17 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:18.303751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-99435576-3b28-48c3-9601-a667e3ce2d6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:18.304613 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-99435576-3b28-48c3-9601-a667e3ce2d6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:18.311217 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-99435576-3b28-48c3-9601-a667e3ce2d6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:18.311906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-99435576-3b28-48c3-9601-a667e3ce2d6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:18.312861 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-99435576-3b28-48c3-9601-a667e3ce2d6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:18.313452 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-99435576-3b28-48c3-9601-a667e3ce2d6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:18.468455 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-99435576-3b28-48c3-9601-a667e3ce2d6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:18.472101 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-760fed15-379f-4d8c-ac91-7e8388477cec tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:18.472833 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-760fed15-379f-4d8c-ac91-7e8388477cec tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:18.476409 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-99435576-3b28-48c3-9601-a667e3ce2d6a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1682 microversion: 2.1 time: 0.177041 May 17 17:16:18.477000 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 400/829] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:18 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:18.486024 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-760fed15-379f-4d8c-ac91-7e8388477cec tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:18.487378 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-760fed15-379f-4d8c-ac91-7e8388477cec tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:18.488732 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-760fed15-379f-4d8c-ac91-7e8388477cec tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:18.489349 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-760fed15-379f-4d8c-ac91-7e8388477cec tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:18.632580 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-760fed15-379f-4d8c-ac91-7e8388477cec tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:18.641163 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-760fed15-379f-4d8c-ac91-7e8388477cec tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.172944 May 17 17:16:18.642453 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 430/830] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:18 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:19.188613 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ff6aadd7-5e28-4c84-b7db-fb1bc7c3d7b7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:19.189222 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ff6aadd7-5e28-4c84-b7db-fb1bc7c3d7b7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:19.195904 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff6aadd7-5e28-4c84-b7db-fb1bc7c3d7b7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:19.196345 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff6aadd7-5e28-4c84-b7db-fb1bc7c3d7b7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:19.197344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff6aadd7-5e28-4c84-b7db-fb1bc7c3d7b7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:19.197795 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ff6aadd7-5e28-4c84-b7db-fb1bc7c3d7b7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:19.366641 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ff6aadd7-5e28-4c84-b7db-fb1bc7c3d7b7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:19.382307 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ff6aadd7-5e28-4c84-b7db-fb1bc7c3d7b7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:19.383846 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ff6aadd7-5e28-4c84-b7db-fb1bc7c3d7b7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:19.386266 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ff6aadd7-5e28-4c84-b7db-fb1bc7c3d7b7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1741 microversion: 2.20 time: 0.201412 May 17 17:16:19.394377 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 401/831] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:19 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1741 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:19.498372 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-56664e31-0f24-466d-b549-08e1877846bc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:19.499018 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-56664e31-0f24-466d-b549-08e1877846bc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:19.508308 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-56664e31-0f24-466d-b549-08e1877846bc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:19.508757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-56664e31-0f24-466d-b549-08e1877846bc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:19.510155 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-56664e31-0f24-466d-b549-08e1877846bc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:19.510593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-56664e31-0f24-466d-b549-08e1877846bc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:19.658746 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a37c445f-eec4-4763-853c-8a96f23779d2 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:19.659643 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a37c445f-eec4-4763-853c-8a96f23779d2 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:19.670780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a37c445f-eec4-4763-853c-8a96f23779d2 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:19.671488 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a37c445f-eec4-4763-853c-8a96f23779d2 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:19.672527 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a37c445f-eec4-4763-853c-8a96f23779d2 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:19.674788 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a37c445f-eec4-4763-853c-8a96f23779d2 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:19.677270 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-56664e31-0f24-466d-b549-08e1877846bc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:19.685178 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-56664e31-0f24-466d-b549-08e1877846bc tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1682 microversion: 2.1 time: 0.190669 May 17 17:16:19.685757 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 431/832] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:19 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:19.947318 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a37c445f-eec4-4763-853c-8a96f23779d2 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:19.966081 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a37c445f-eec4-4763-853c-8a96f23779d2 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.311291 May 17 17:16:19.976132 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 402/833] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:19 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:16:20.412348 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-bf8fbfc9-3fd9-40cb-840d-182561e41535 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:20.413544 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-bf8fbfc9-3fd9-40cb-840d-182561e41535 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:20.420900 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf8fbfc9-3fd9-40cb-840d-182561e41535 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:20.421498 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf8fbfc9-3fd9-40cb-840d-182561e41535 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:20.422390 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf8fbfc9-3fd9-40cb-840d-182561e41535 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:20.422933 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf8fbfc9-3fd9-40cb-840d-182561e41535 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:20.627750 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-bf8fbfc9-3fd9-40cb-840d-182561e41535 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:20.642640 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-bf8fbfc9-3fd9-40cb-840d-182561e41535 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:20.646553 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-bf8fbfc9-3fd9-40cb-840d-182561e41535 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:20.651702 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-bf8fbfc9-3fd9-40cb-840d-182561e41535 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1741 microversion: 2.20 time: 0.243223 May 17 17:16:20.652529 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 432/834] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:20 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1741 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:20.703997 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9bef3756-0bcb-44d9-979f-40633eb67cb9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:20.704891 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9bef3756-0bcb-44d9-979f-40633eb67cb9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:20.719731 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9bef3756-0bcb-44d9-979f-40633eb67cb9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:20.722413 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9bef3756-0bcb-44d9-979f-40633eb67cb9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:20.724419 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9bef3756-0bcb-44d9-979f-40633eb67cb9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:20.726134 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9bef3756-0bcb-44d9-979f-40633eb67cb9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:20.762329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-3f38081c-d6ec-48dc-992d-48f9d5fb1b21 req-e7ff0fa8-4d24-422c-9635-70ee83ac504a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d54d34-bc48-4fdd-8665-f9403cbb8c8f", "name": "network-vif-deleted", "tag": "76a127a7-c717-441d-befd-aa3e03f6d0bc"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:20.796662 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-3f38081c-d6ec-48dc-992d-48f9d5fb1b21 req-e7ff0fa8-4d24-422c-9635-70ee83ac504a service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:20.798537 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-3f38081c-d6ec-48dc-992d-48f9d5fb1b21 req-e7ff0fa8-4d24-422c-9635-70ee83ac504a service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:20.829773 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-3f38081c-d6ec-48dc-992d-48f9d5fb1b21 req-e7ff0fa8-4d24-422c-9635-70ee83ac504a service nova] Creating event network-vif-deleted:76a127a7-c717-441d-befd-aa3e03f6d0bc for instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f on hv-cinder-84214 May 17 17:16:20.841790 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-3f38081c-d6ec-48dc-992d-48f9d5fb1b21 req-e7ff0fa8-4d24-422c-9635-70ee83ac504a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245560 May 17 17:16:20.842703 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9bef3756-0bcb-44d9-979f-40633eb67cb9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:20.846709 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9bef3756-0bcb-44d9-979f-40633eb67cb9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:20.847230 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 403/835] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:20.847714 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-9bef3756-0bcb-44d9-979f-40633eb67cb9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lazy-loading 'fault' on Instance uuid c3d54d34-bc48-4fdd-8665-f9403cbb8c8f {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:16:20.898808 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9bef3756-0bcb-44d9-979f-40633eb67cb9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:20.908277 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9bef3756-0bcb-44d9-979f-40633eb67cb9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 200 len: 1332 microversion: 2.1 time: 0.209093 May 17 17:16:20.909215 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 433/836] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:20 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 1332 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:20.985924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a59a45ac-724c-446e-a0ac-9941b91217a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:20.986642 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a59a45ac-724c-446e-a0ac-9941b91217a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:21.000703 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a59a45ac-724c-446e-a0ac-9941b91217a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:21.001164 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a59a45ac-724c-446e-a0ac-9941b91217a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:21.001965 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a59a45ac-724c-446e-a0ac-9941b91217a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:21.002404 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a59a45ac-724c-446e-a0ac-9941b91217a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:21.175841 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a59a45ac-724c-446e-a0ac-9941b91217a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:21.184183 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a59a45ac-724c-446e-a0ac-9941b91217a1 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1508 microversion: 2.1 time: 0.205495 May 17 17:16:21.189702 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 404/837] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:20 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1508 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:16:21.207194 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d368f58d-0968-41c2-a277-4e295d75e824 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:21.211703 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d368f58d-0968-41c2-a277-4e295d75e824 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:21.222583 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d368f58d-0968-41c2-a277-4e295d75e824 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:21.223290 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d368f58d-0968-41c2-a277-4e295d75e824 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:21.224862 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d368f58d-0968-41c2-a277-4e295d75e824 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:21.225486 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d368f58d-0968-41c2-a277-4e295d75e824 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:21.327030 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d368f58d-0968-41c2-a277-4e295d75e824 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "POST /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f/action" status: 202 len: 0 microversion: 2.1 time: 0.124470 May 17 17:16:21.328426 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 434/838] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 17 17:16:21 2022] POST /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:16:21.336283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-267b9252-0c6d-4865-8011-f62ba8e6e379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:21.337422 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-267b9252-0c6d-4865-8011-f62ba8e6e379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:21.348464 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-267b9252-0c6d-4865-8011-f62ba8e6e379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:21.348986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-267b9252-0c6d-4865-8011-f62ba8e6e379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:21.349838 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-267b9252-0c6d-4865-8011-f62ba8e6e379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:21.350349 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-267b9252-0c6d-4865-8011-f62ba8e6e379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:21.555254 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-267b9252-0c6d-4865-8011-f62ba8e6e379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:21.565367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-267b9252-0c6d-4865-8011-f62ba8e6e379 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1516 microversion: 2.1 time: 0.232919 May 17 17:16:21.576629 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 405/839] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:21 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1516 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:21.672492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f1166449-e5e6-4ac1-9785-32cff3dedcb3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:21.673486 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f1166449-e5e6-4ac1-9785-32cff3dedcb3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:21.690518 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f1166449-e5e6-4ac1-9785-32cff3dedcb3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:21.691464 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f1166449-e5e6-4ac1-9785-32cff3dedcb3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:21.694108 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f1166449-e5e6-4ac1-9785-32cff3dedcb3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:21.697322 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f1166449-e5e6-4ac1-9785-32cff3dedcb3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:21.925590 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b16be40f-295b-4835-a67b-36eea4dbc0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:21.926920 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-b16be40f-295b-4835-a67b-36eea4dbc0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:21.957651 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b16be40f-295b-4835-a67b-36eea4dbc0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:21.957946 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f1166449-e5e6-4ac1-9785-32cff3dedcb3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:21.958228 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b16be40f-295b-4835-a67b-36eea4dbc0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:21.959398 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b16be40f-295b-4835-a67b-36eea4dbc0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:21.960586 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b16be40f-295b-4835-a67b-36eea4dbc0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:21.967173 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f1166449-e5e6-4ac1-9785-32cff3dedcb3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:21.969532 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f1166449-e5e6-4ac1-9785-32cff3dedcb3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:21.971000 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f1166449-e5e6-4ac1-9785-32cff3dedcb3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1741 microversion: 2.20 time: 0.304286 May 17 17:16:21.976063 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 435/840] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:21 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1741 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:22.012006 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-b16be40f-295b-4835-a67b-36eea4dbc0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] HTTP exception thrown: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b16be40f-295b-4835-a67b-36eea4dbc0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Request method failure captured: May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f HTTP/1.1 May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9dPWJVb7qwYBnOyu2SibnIHb7br9I07PYlwLrrT_SRrqmmG-Yk2L4b9g7-opL8KlEa-VvVIvtF7WR6pTkYQoWCb_iUMaherr4GYvkZBEx7i_4xoMizUYe3fXvOKjqnKrfi4cSl1B6_TYNoX5UI1IzkedqJD3SKAMFqJ-H9rW400QlM May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:16:22.013712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:16:22.015237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:16:22.015237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:16:22.015237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:16:22.015237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:16:22.015237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:16:22.015237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:16:22.015237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:16:22.015237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 61daaf70d25c4e1592fcb2f4feafff86 May 17 17:16:22.015237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:16:22.015237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:16:22.015237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:16:22.015237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': 'c3d54d34-bc48-4fdd-8665-f9403cbb8c8f'} May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:16:22.016073 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:16:22.017394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:16:22.018525 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b16be40f-295b-4835-a67b-36eea4dbc0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Returning 404 to user: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:16:22.018525 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-b16be40f-295b-4835-a67b-36eea4dbc0a5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 404 len: 111 microversion: 2.1 time: 0.093471 May 17 17:16:22.024854 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-642494ce-ba44-4507-aa25-9b8055919202 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '.version_select at 0x7feb12ea0700>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:22.030096 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 406/841] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:21 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:16:22.064038 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-642494ce-ba44-4507-aa25-9b8055919202 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325258293" status: 202 len: 0 microversion: 2.1 time: 0.043161 May 17 17:16:22.068725 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 436/842] 10.222.0.48 () {58 vars in 1220 bytes} [Tue May 17 17:16:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325258293 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:16:22.376188 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-87eaf192-feb8-4934-984f-c165005d7d2a req-ace6477d-ebd0-42d8-8b9f-7cb3676b0274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d1426b-07f8-410e-b753-b1d8e9c1102f", "name": "network-vif-unplugged", "status": "completed", "tag": "72213c8f-95d2-4e6b-bc71-ec5cf8e62273"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:22.403049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-87eaf192-feb8-4934-984f-c165005d7d2a req-ace6477d-ebd0-42d8-8b9f-7cb3676b0274 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:22.404015 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-87eaf192-feb8-4934-984f-c165005d7d2a req-ace6477d-ebd0-42d8-8b9f-7cb3676b0274 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:22.428328 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.compute.server_external_events [req-87eaf192-feb8-4934-984f-c165005d7d2a req-ace6477d-ebd0-42d8-8b9f-7cb3676b0274 service nova] Unable to find a host for instance 47d1426b-07f8-410e-b753-b1d8e9c1102f. Dropping event network-vif-unplugged {{(pid=117089) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 17 17:16:22.429952 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-87eaf192-feb8-4934-984f-c165005d7d2a req-ace6477d-ebd0-42d8-8b9f-7cb3676b0274 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.059992 May 17 17:16:22.432346 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 407/843] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 62 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 17 17:16:22.594450 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-01de3626-f126-4cdd-a766-4405a9a1e354 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:22.595431 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-01de3626-f126-4cdd-a766-4405a9a1e354 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:22.603528 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-01de3626-f126-4cdd-a766-4405a9a1e354 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:22.604359 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-01de3626-f126-4cdd-a766-4405a9a1e354 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:22.605351 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-01de3626-f126-4cdd-a766-4405a9a1e354 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:22.605999 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-01de3626-f126-4cdd-a766-4405a9a1e354 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:22.770675 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-01de3626-f126-4cdd-a766-4405a9a1e354 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:22.779926 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-01de3626-f126-4cdd-a766-4405a9a1e354 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1516 microversion: 2.1 time: 0.189753 May 17 17:16:22.780732 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 437/844] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:22 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:22.910449 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-07a4a5db-af8f-4cb4-8e0b-8623b4c42caa tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Action: 'create', calling method: .version_select at 0x7feb1805ddc0>, body: {"keypair": {"name": "tempest-keypair-447927977", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpLBcb5a3qKgmKq/1SvvG7yinK2gnvyXWtprzfU1fI01jLpUOnObbh8kGoCu6EvyGnCNZpDOdZhZyTpahAo7Bc93DycWx3NFbSb2EolHIn3IkoeEnM3BD7E18q2Tuqc+w=="}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:22.925582 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-07a4a5db-af8f-4cb4-8e0b-8623b4c42caa tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'key_pairs'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:16:22.929846 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-07a4a5db-af8f-4cb4-8e0b-8623b4c42caa tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for user 61daaf70d25c4e1592fcb2f4feafff86 and project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'key_pairs'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:16:22.956101 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-07a4a5db-af8f-4cb4-8e0b-8623b4c42caa tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049803 May 17 17:16:22.962620 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 408/845] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 17 17:16:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:22.995017 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-463aa31d-6497-4a8a-8dca-88252ba77157 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:22.995901 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-463aa31d-6497-4a8a-8dca-88252ba77157 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:23.008634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-463aa31d-6497-4a8a-8dca-88252ba77157 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:23.009210 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-463aa31d-6497-4a8a-8dca-88252ba77157 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:23.010263 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-463aa31d-6497-4a8a-8dca-88252ba77157 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:23.010783 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-463aa31d-6497-4a8a-8dca-88252ba77157 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:23.258423 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-463aa31d-6497-4a8a-8dca-88252ba77157 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:23.270034 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-463aa31d-6497-4a8a-8dca-88252ba77157 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:23.271637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-463aa31d-6497-4a8a-8dca-88252ba77157 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:23.272970 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-463aa31d-6497-4a8a-8dca-88252ba77157 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1741 microversion: 2.20 time: 0.282801 May 17 17:16:23.273707 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 438/846] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:22 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1741 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:23.798514 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1389fb45-d838-4a7c-a09c-7a6bdf325d33 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:23.799432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1389fb45-d838-4a7c-a09c-7a6bdf325d33 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:23.811193 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1389fb45-d838-4a7c-a09c-7a6bdf325d33 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:23.812107 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1389fb45-d838-4a7c-a09c-7a6bdf325d33 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:23.813177 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1389fb45-d838-4a7c-a09c-7a6bdf325d33 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:23.813848 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1389fb45-d838-4a7c-a09c-7a6bdf325d33 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:24.017337 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1389fb45-d838-4a7c-a09c-7a6bdf325d33 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:24.026762 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1389fb45-d838-4a7c-a09c-7a6bdf325d33 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1516 microversion: 2.1 time: 0.232116 May 17 17:16:24.027543 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 409/847] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:23 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:24.294362 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8bdc25e6-42c7-4bd1-9406-0e3a80fdbd32 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:24.295115 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8bdc25e6-42c7-4bd1-9406-0e3a80fdbd32 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:24.312265 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8bdc25e6-42c7-4bd1-9406-0e3a80fdbd32 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:24.312717 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8bdc25e6-42c7-4bd1-9406-0e3a80fdbd32 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:24.313506 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8bdc25e6-42c7-4bd1-9406-0e3a80fdbd32 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:24.313944 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8bdc25e6-42c7-4bd1-9406-0e3a80fdbd32 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:24.531187 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8bdc25e6-42c7-4bd1-9406-0e3a80fdbd32 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:24.540658 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8bdc25e6-42c7-4bd1-9406-0e3a80fdbd32 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:24.542326 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8bdc25e6-42c7-4bd1-9406-0e3a80fdbd32 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:24.543497 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8bdc25e6-42c7-4bd1-9406-0e3a80fdbd32 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1741 microversion: 2.20 time: 0.255562 May 17 17:16:24.544080 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 439/848] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:24 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1741 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:24.573875 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-359396365", "imageRef": "bd1c526c-9875-429f-b3d1-4e616a3aefb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30541785-dceb-40b7-9575-992b66a470e9"}], "security_groups": [{"name": "tempest-securitygroup--1232874416"}], "key_name": "tempest-keypair-447927977", "user_data": "}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:24.682516 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] validate_networks() for [('30541785-dceb-40b7-9575-992b66a470e9', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:16:25.045847 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-dd6da149-a1c0-46ab-81a6-f17d738a22d8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:25.046710 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-dd6da149-a1c0-46ab-81a6-f17d738a22d8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:25.061209 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dd6da149-a1c0-46ab-81a6-f17d738a22d8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:25.061667 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dd6da149-a1c0-46ab-81a6-f17d738a22d8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:25.062450 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dd6da149-a1c0-46ab-81a6-f17d738a22d8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:25.062893 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dd6da149-a1c0-46ab-81a6-f17d738a22d8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:25.452462 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:16:25.453063 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:16:25.453609 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:16:25.454020 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:16:25.454487 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:16:25.464039 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:25.464852 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:25.465653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:25.466091 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:25.484897 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:16:25.487203 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Getting quotas for user 61daaf70d25c4e1592fcb2f4feafff86 and project 54981d1c7fe64f5cb6a846496ad4f776. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:16:25.488776 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-dd6da149-a1c0-46ab-81a6-f17d738a22d8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:25.497634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-dd6da149-a1c0-46ab-81a6-f17d738a22d8 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1518 microversion: 2.1 time: 0.456350 May 17 17:16:25.498478 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 440/849] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:25 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1518 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:25.499848 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:16:25.502210 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd1c526c-9875-429f-b3d1-4e616a3aefb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:16:25.552814 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2c411acf-11f0-4cda-80c2-d18be8b27a03 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.984788 May 17 17:16:25.553597 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 410/850] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:16:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 17:16:25.563909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-48666604-5ba5-4c1e-bb3a-36ca79052fa1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:25.564116 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8bd18ed9-3ce8-4144-a0db-0ad9601028e4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:25.564524 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-48666604-5ba5-4c1e-bb3a-36ca79052fa1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:25.564700 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8bd18ed9-3ce8-4144-a0db-0ad9601028e4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:25.571120 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8bd18ed9-3ce8-4144-a0db-0ad9601028e4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:25.571650 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8bd18ed9-3ce8-4144-a0db-0ad9601028e4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:25.573127 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8bd18ed9-3ce8-4144-a0db-0ad9601028e4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:25.573564 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8bd18ed9-3ce8-4144-a0db-0ad9601028e4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:25.624191 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-48666604-5ba5-4c1e-bb3a-36ca79052fa1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:25.630872 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-48666604-5ba5-4c1e-bb3a-36ca79052fa1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1240 microversion: 2.1 time: 0.070617 May 17 17:16:25.631637 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 411/851] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:25 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:25.740453 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8bd18ed9-3ce8-4144-a0db-0ad9601028e4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:25.750396 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8bd18ed9-3ce8-4144-a0db-0ad9601028e4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:25.752252 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8bd18ed9-3ce8-4144-a0db-0ad9601028e4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:25.753661 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8bd18ed9-3ce8-4144-a0db-0ad9601028e4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1741 microversion: 2.20 time: 0.193305 May 17 17:16:25.754483 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 441/852] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:25 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:16:26.516185 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1bd1bd0b-ec3e-42e0-9ba2-7f3fe384ca45 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:26.516743 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1bd1bd0b-ec3e-42e0-9ba2-7f3fe384ca45 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:26.526887 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1bd1bd0b-ec3e-42e0-9ba2-7f3fe384ca45 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:26.527380 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1bd1bd0b-ec3e-42e0-9ba2-7f3fe384ca45 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:26.528217 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1bd1bd0b-ec3e-42e0-9ba2-7f3fe384ca45 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:26.528909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1bd1bd0b-ec3e-42e0-9ba2-7f3fe384ca45 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:26.648103 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b649ae38-e286-4e4e-9baa-4034531485d5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:26.648891 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b649ae38-e286-4e4e-9baa-4034531485d5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:26.658344 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b649ae38-e286-4e4e-9baa-4034531485d5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:26.659179 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b649ae38-e286-4e4e-9baa-4034531485d5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:26.660401 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b649ae38-e286-4e4e-9baa-4034531485d5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:26.661185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b649ae38-e286-4e4e-9baa-4034531485d5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:26.685098 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1bd1bd0b-ec3e-42e0-9ba2-7f3fe384ca45 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:26.694462 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1bd1bd0b-ec3e-42e0-9ba2-7f3fe384ca45 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.181674 May 17 17:16:26.695923 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 412/853] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:26 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:26.755586 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b649ae38-e286-4e4e-9baa-4034531485d5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:26.764536 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b649ae38-e286-4e4e-9baa-4034531485d5 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1292 microversion: 2.1 time: 0.120114 May 17 17:16:26.765149 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 442/854] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:26 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1292 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:26.774226 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9fc55819-a9d1-43e5-a8d5-630640771c8e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:26.776349 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9fc55819-a9d1-43e5-a8d5-630640771c8e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:26.783444 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9fc55819-a9d1-43e5-a8d5-630640771c8e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:26.783933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9fc55819-a9d1-43e5-a8d5-630640771c8e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:26.784731 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9fc55819-a9d1-43e5-a8d5-630640771c8e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:26.785165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9fc55819-a9d1-43e5-a8d5-630640771c8e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:26.943056 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9fc55819-a9d1-43e5-a8d5-630640771c8e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:26.952665 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9fc55819-a9d1-43e5-a8d5-630640771c8e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:26.954253 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9fc55819-a9d1-43e5-a8d5-630640771c8e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:26.955845 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9fc55819-a9d1-43e5-a8d5-630640771c8e tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1723 microversion: 2.20 time: 0.186563 May 17 17:16:26.956777 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 413/855] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:26 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:27.713427 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-915cf14f-a10e-4cfd-aca4-cdd19ff0a783 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:27.714118 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-915cf14f-a10e-4cfd-aca4-cdd19ff0a783 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:27.720283 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-915cf14f-a10e-4cfd-aca4-cdd19ff0a783 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:27.720730 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-915cf14f-a10e-4cfd-aca4-cdd19ff0a783 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:27.721493 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-915cf14f-a10e-4cfd-aca4-cdd19ff0a783 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:27.721929 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-915cf14f-a10e-4cfd-aca4-cdd19ff0a783 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:27.785002 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a642fa64-fd19-40e7-84b8-8fefad7387bb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:27.785612 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a642fa64-fd19-40e7-84b8-8fefad7387bb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:27.792590 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a642fa64-fd19-40e7-84b8-8fefad7387bb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:27.793050 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a642fa64-fd19-40e7-84b8-8fefad7387bb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:27.794365 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a642fa64-fd19-40e7-84b8-8fefad7387bb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:27.794836 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a642fa64-fd19-40e7-84b8-8fefad7387bb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:27.881432 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-915cf14f-a10e-4cfd-aca4-cdd19ff0a783 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:27.889943 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-915cf14f-a10e-4cfd-aca4-cdd19ff0a783 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.180823 May 17 17:16:27.890508 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 443/856] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:27 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:27.954063 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a642fa64-fd19-40e7-84b8-8fefad7387bb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:27.961734 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a642fa64-fd19-40e7-84b8-8fefad7387bb tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.180596 May 17 17:16:27.963697 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 414/857] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:27 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:16:27.974868 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d89c5739-f50d-4d94-a7db-6535ce21b30d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:27.975476 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d89c5739-f50d-4d94-a7db-6535ce21b30d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:27.981954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d89c5739-f50d-4d94-a7db-6535ce21b30d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:27.982410 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d89c5739-f50d-4d94-a7db-6535ce21b30d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:27.983191 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d89c5739-f50d-4d94-a7db-6535ce21b30d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:27.983653 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d89c5739-f50d-4d94-a7db-6535ce21b30d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:28.121071 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d89c5739-f50d-4d94-a7db-6535ce21b30d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:28.128822 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d89c5739-f50d-4d94-a7db-6535ce21b30d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:28.130435 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d89c5739-f50d-4d94-a7db-6535ce21b30d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:28.131591 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d89c5739-f50d-4d94-a7db-6535ce21b30d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1723 microversion: 2.20 time: 0.161310 May 17 17:16:28.132174 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 444/858] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:27 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:28.909920 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-fb2f1c9d-7a53-4fb5-83ba-29604d9d4a29 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:28.910543 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-fb2f1c9d-7a53-4fb5-83ba-29604d9d4a29 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:28.917579 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fb2f1c9d-7a53-4fb5-83ba-29604d9d4a29 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:28.918037 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fb2f1c9d-7a53-4fb5-83ba-29604d9d4a29 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:28.918815 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fb2f1c9d-7a53-4fb5-83ba-29604d9d4a29 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:28.919260 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fb2f1c9d-7a53-4fb5-83ba-29604d9d4a29 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:28.980974 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-0615d693-060d-42fd-8a27-dbb05677f755 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:28.981709 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-0615d693-060d-42fd-8a27-dbb05677f755 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:28.988250 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0615d693-060d-42fd-8a27-dbb05677f755 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:28.988706 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0615d693-060d-42fd-8a27-dbb05677f755 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:28.989483 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0615d693-060d-42fd-8a27-dbb05677f755 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:28.989923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0615d693-060d-42fd-8a27-dbb05677f755 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:29.080296 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-fb2f1c9d-7a53-4fb5-83ba-29604d9d4a29 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:29.088852 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-fb2f1c9d-7a53-4fb5-83ba-29604d9d4a29 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.182750 May 17 17:16:29.089639 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 415/859] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:28 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:16:29.139625 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-0615d693-060d-42fd-8a27-dbb05677f755 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:29.147047 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-0615d693-060d-42fd-8a27-dbb05677f755 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.170500 May 17 17:16:29.147627 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 445/860] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:28 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:29.150566 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-072dc210-e9d1-4291-9059-57dd2dea4430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:29.151239 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-072dc210-e9d1-4291-9059-57dd2dea4430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:29.157261 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-072dc210-e9d1-4291-9059-57dd2dea4430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:29.157713 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-072dc210-e9d1-4291-9059-57dd2dea4430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:29.158472 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-072dc210-e9d1-4291-9059-57dd2dea4430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:29.158907 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-072dc210-e9d1-4291-9059-57dd2dea4430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:29.285651 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-072dc210-e9d1-4291-9059-57dd2dea4430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:29.294097 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-072dc210-e9d1-4291-9059-57dd2dea4430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:29.295586 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-072dc210-e9d1-4291-9059-57dd2dea4430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:29.296753 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-072dc210-e9d1-4291-9059-57dd2dea4430 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1723 microversion: 2.20 time: 0.150762 May 17 17:16:29.297322 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 416/861] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:29 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:16:30.106193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-02f70dbf-8d92-43c5-962b-d05b350b294e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:30.106838 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-02f70dbf-8d92-43c5-962b-d05b350b294e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:30.113237 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-02f70dbf-8d92-43c5-962b-d05b350b294e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:30.113687 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-02f70dbf-8d92-43c5-962b-d05b350b294e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:30.114445 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-02f70dbf-8d92-43c5-962b-d05b350b294e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:30.114879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-02f70dbf-8d92-43c5-962b-d05b350b294e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:30.164595 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ac79dbf3-9737-410a-bff6-8849a1d1640a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:30.165952 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ac79dbf3-9737-410a-bff6-8849a1d1640a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:30.172517 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ac79dbf3-9737-410a-bff6-8849a1d1640a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:30.172968 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ac79dbf3-9737-410a-bff6-8849a1d1640a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:30.173743 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ac79dbf3-9737-410a-bff6-8849a1d1640a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:30.174185 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ac79dbf3-9737-410a-bff6-8849a1d1640a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:30.288920 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-02f70dbf-8d92-43c5-962b-d05b350b294e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:30.297102 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-02f70dbf-8d92-43c5-962b-d05b350b294e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.195226 May 17 17:16:30.297684 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 446/862] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:30 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:30.313963 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ffaffad1-3670-4457-aeef-fdabd681feba tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:30.314560 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ffaffad1-3670-4457-aeef-fdabd681feba tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:30.320316 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ffaffad1-3670-4457-aeef-fdabd681feba tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:30.320841 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ffaffad1-3670-4457-aeef-fdabd681feba tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:30.321640 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ffaffad1-3670-4457-aeef-fdabd681feba tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:30.322068 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ffaffad1-3670-4457-aeef-fdabd681feba tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:30.329469 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ac79dbf3-9737-410a-bff6-8849a1d1640a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:30.336734 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ac79dbf3-9737-410a-bff6-8849a1d1640a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.175912 May 17 17:16:30.337295 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 417/863] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:30 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:16:30.437384 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4b676941-474a-4b30-8ec9-5c9184c2d0d8 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:30.437869 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4b676941-474a-4b30-8ec9-5c9184c2d0d8 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:30.445500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4b676941-474a-4b30-8ec9-5c9184c2d0d8 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:30.445985 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4b676941-474a-4b30-8ec9-5c9184c2d0d8 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:30.446780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4b676941-474a-4b30-8ec9-5c9184c2d0d8 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:30.447218 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4b676941-474a-4b30-8ec9-5c9184c2d0d8 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:30.476623 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ffaffad1-3670-4457-aeef-fdabd681feba tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:30.487463 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ffaffad1-3670-4457-aeef-fdabd681feba tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:30.490455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ffaffad1-3670-4457-aeef-fdabd681feba tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:30.493111 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ffaffad1-3670-4457-aeef-fdabd681feba tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1723 microversion: 2.20 time: 0.181774 May 17 17:16:30.495197 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 447/864] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:30 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:16:30.501865 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4b676941-474a-4b30-8ec9-5c9184c2d0d8 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/ips" status: 200 len: 146 microversion: 2.1 time: 0.069288 May 17 17:16:30.503328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-145b61f4-efb6-40f9-ba34-07a8f1c23d43 req-a377e0a5-f030-41e4-a4d0-e38820e729a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6de88f8-538f-45eb-bfcd-fce744a5c55d", "name": "network-vif-unplugged", "status": "completed", "tag": "e349ab19-ab43-4bf5-8128-4ce8f8b7a5f5"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:30.507817 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 418/865] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 17 17:16:30 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/ips => generated 146 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:30.519513 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-145b61f4-efb6-40f9-ba34-07a8f1c23d43 req-a377e0a5-f030-41e4-a4d0-e38820e729a0 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:30.520169 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-145b61f4-efb6-40f9-ba34-07a8f1c23d43 req-a377e0a5-f030-41e4-a4d0-e38820e729a0 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:30.538066 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-145b61f4-efb6-40f9-ba34-07a8f1c23d43 req-a377e0a5-f030-41e4-a4d0-e38820e729a0 service nova] Creating event network-vif-unplugged:e349ab19-ab43-4bf5-8128-4ce8f8b7a5f5 for instance b6de88f8-538f-45eb-bfcd-fce744a5c55d on hv-cinder-84214 May 17 17:16:30.545086 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-145b61f4-efb6-40f9-ba34-07a8f1c23d43 req-a377e0a5-f030-41e4-a4d0-e38820e729a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047224 May 17 17:16:30.545825 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 448/866] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:31.315362 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-dc6adcc3-9a09-482c-b9e9-2c002f9f3357 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:31.322718 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-dc6adcc3-9a09-482c-b9e9-2c002f9f3357 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:31.327676 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-b2afbb13-3b28-4803-beff-6c270218ef16 req-b217492d-7267-4c37-9720-57ba32f3a725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b233a28b-810a-4304-a7cb-93b1c24f76fe", "tag": "791f659d-31d5-4dc2-b5c3-e9c1d9bd7f25"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:31.334945 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dc6adcc3-9a09-482c-b9e9-2c002f9f3357 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:31.335417 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dc6adcc3-9a09-482c-b9e9-2c002f9f3357 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:31.336262 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dc6adcc3-9a09-482c-b9e9-2c002f9f3357 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:31.336811 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dc6adcc3-9a09-482c-b9e9-2c002f9f3357 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:31.337821 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-b2afbb13-3b28-4803-beff-6c270218ef16 req-b217492d-7267-4c37-9720-57ba32f3a725 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:31.338452 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-b2afbb13-3b28-4803-beff-6c270218ef16 req-b217492d-7267-4c37-9720-57ba32f3a725 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:31.350153 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-b2afbb13-3b28-4803-beff-6c270218ef16 req-b217492d-7267-4c37-9720-57ba32f3a725 service nova] Creating event network-changed:791f659d-31d5-4dc2-b5c3-e9c1d9bd7f25 for instance b233a28b-810a-4304-a7cb-93b1c24f76fe on hv-cinder-84214 May 17 17:16:31.356128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-b2afbb13-3b28-4803-beff-6c270218ef16 req-b217492d-7267-4c37-9720-57ba32f3a725 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033658 May 17 17:16:31.357428 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 449/867] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:16:31.365005 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-6d5403db-0d32-4b4b-8d94-5014462a33df tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:31.366335 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-6d5403db-0d32-4b4b-8d94-5014462a33df tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:31.374192 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6d5403db-0d32-4b4b-8d94-5014462a33df tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:31.374642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6d5403db-0d32-4b4b-8d94-5014462a33df tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:31.376370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6d5403db-0d32-4b4b-8d94-5014462a33df tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:31.376838 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6d5403db-0d32-4b4b-8d94-5014462a33df tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:31.548137 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-dc6adcc3-9a09-482c-b9e9-2c002f9f3357 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:31.557317 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-dc6adcc3-9a09-482c-b9e9-2c002f9f3357 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.246778 May 17 17:16:31.559665 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 419/868] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:31 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:31.571422 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-80d17e27-f490-4d3a-ae5e-e3ffcb01ce00 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:31.572415 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-80d17e27-f490-4d3a-ae5e-e3ffcb01ce00 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:31.578894 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80d17e27-f490-4d3a-ae5e-e3ffcb01ce00 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:31.579355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80d17e27-f490-4d3a-ae5e-e3ffcb01ce00 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:31.580173 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80d17e27-f490-4d3a-ae5e-e3ffcb01ce00 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:31.580620 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80d17e27-f490-4d3a-ae5e-e3ffcb01ce00 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:31.603450 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-6d5403db-0d32-4b4b-8d94-5014462a33df tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:31.613861 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-6d5403db-0d32-4b4b-8d94-5014462a33df tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.254959 May 17 17:16:31.615668 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 450/869] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:31 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:31.733119 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-80d17e27-f490-4d3a-ae5e-e3ffcb01ce00 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:31.746960 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-80d17e27-f490-4d3a-ae5e-e3ffcb01ce00 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:31.748620 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-80d17e27-f490-4d3a-ae5e-e3ffcb01ce00 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:31.750573 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-80d17e27-f490-4d3a-ae5e-e3ffcb01ce00 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1666 microversion: 2.20 time: 0.189691 May 17 17:16:31.751243 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 420/870] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:31 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1666 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:31.770344 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-aa004b4f-7a3d-4edb-9da5-e8cc5f346fd7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00b80b95-2b8a-48c5-b5d1-cdf935246ec0"}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:31.771531 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-aa004b4f-7a3d-4edb-9da5-e8cc5f346fd7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:31.777741 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aa004b4f-7a3d-4edb-9da5-e8cc5f346fd7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:31.778290 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aa004b4f-7a3d-4edb-9da5-e8cc5f346fd7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:31.779401 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aa004b4f-7a3d-4edb-9da5-e8cc5f346fd7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:31.779926 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aa004b4f-7a3d-4edb-9da5-e8cc5f346fd7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:31.892292 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-08309382-04ac-4974-86d0-71cbd69961b5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ca6a66c-eab6-4007-913e-e676adcd778e"}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:31.894836 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-08309382-04ac-4974-86d0-71cbd69961b5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:31.907147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-08309382-04ac-4974-86d0-71cbd69961b5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:31.907681 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-08309382-04ac-4974-86d0-71cbd69961b5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:31.908602 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-08309382-04ac-4974-86d0-71cbd69961b5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:31.909092 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-08309382-04ac-4974-86d0-71cbd69961b5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:32.093597 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-aa004b4f-7a3d-4edb-9da5-e8cc5f346fd7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "POST /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327389 May 17 17:16:32.098747 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 451/871] 10.222.0.48 () {62 vars in 1363 bytes} [Tue May 17 17:16:31 2022] POST /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d/os-volume_attachments => generated 188 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:16:32.182903 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-08309382-04ac-4974-86d0-71cbd69961b5 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "POST /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294379 May 17 17:16:32.184585 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 421/872] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 17 17:16:31 2022] POST /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:32.228082 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-919dcf0e-963a-4c88-b4a5-d2da9c0e954b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:32.228931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-919dcf0e-963a-4c88-b4a5-d2da9c0e954b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:32.236583 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-919dcf0e-963a-4c88-b4a5-d2da9c0e954b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:32.237408 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-919dcf0e-963a-4c88-b4a5-d2da9c0e954b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:32.238457 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-919dcf0e-963a-4c88-b4a5-d2da9c0e954b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:32.239091 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-919dcf0e-963a-4c88-b4a5-d2da9c0e954b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:32.469379 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-919dcf0e-963a-4c88-b4a5-d2da9c0e954b tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d/os-volume_attachments/00b80b95-2b8a-48c5-b5d1-cdf935246ec0" status: 202 len: 0 microversion: 2.20 time: 0.246362 May 17 17:16:32.470101 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 452/873] 10.222.0.48 () {60 vars in 1456 bytes} [Tue May 17 17:16:32 2022] DELETE /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d/os-volume_attachments/00b80b95-2b8a-48c5-b5d1-cdf935246ec0 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 17:16:32.525961 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-92d6d0ed-3777-4eb0-80c3-efde1983deb6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:32.526616 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-92d6d0ed-3777-4eb0-80c3-efde1983deb6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:32.533131 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-92d6d0ed-3777-4eb0-80c3-efde1983deb6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:32.533571 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-92d6d0ed-3777-4eb0-80c3-efde1983deb6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:32.534337 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-92d6d0ed-3777-4eb0-80c3-efde1983deb6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:32.534780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-92d6d0ed-3777-4eb0-80c3-efde1983deb6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:32.576119 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ced7d20d-b6dc-43f2-aed7-1e422ae91b0a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:32.576812 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ced7d20d-b6dc-43f2-aed7-1e422ae91b0a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:32.582700 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ced7d20d-b6dc-43f2-aed7-1e422ae91b0a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:32.583219 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ced7d20d-b6dc-43f2-aed7-1e422ae91b0a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:32.584080 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ced7d20d-b6dc-43f2-aed7-1e422ae91b0a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:32.584579 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ced7d20d-b6dc-43f2-aed7-1e422ae91b0a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:32.628356 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-92d6d0ed-3777-4eb0-80c3-efde1983deb6 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "POST /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d/action" status: 202 len: 0 microversion: 2.20 time: 0.107618 May 17 17:16:32.629111 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 422/874] 10.222.0.48 () {62 vars in 1318 bytes} [Tue May 17 17:16:32 2022] POST /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 17:16:32.634865 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b0c0bbe9-e31a-4334-8f0b-4848f90cbddf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:32.635468 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-b0c0bbe9-e31a-4334-8f0b-4848f90cbddf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:32.641837 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b0c0bbe9-e31a-4334-8f0b-4848f90cbddf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:32.641994 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b0c0bbe9-e31a-4334-8f0b-4848f90cbddf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:32.643114 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b0c0bbe9-e31a-4334-8f0b-4848f90cbddf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:32.643551 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b0c0bbe9-e31a-4334-8f0b-4848f90cbddf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:32.763783 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ced7d20d-b6dc-43f2-aed7-1e422ae91b0a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:32.773830 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ced7d20d-b6dc-43f2-aed7-1e422ae91b0a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.201466 May 17 17:16:32.792151 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 453/875] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:32 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:16:32.797479 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-fa03ce31-4a70-42ab-a5f8-fb5bd4cd0383 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:32.798034 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-fa03ce31-4a70-42ab-a5f8-fb5bd4cd0383 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:32.808268 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fa03ce31-4a70-42ab-a5f8-fb5bd4cd0383 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:32.808997 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fa03ce31-4a70-42ab-a5f8-fb5bd4cd0383 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:32.809998 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fa03ce31-4a70-42ab-a5f8-fb5bd4cd0383 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:32.810874 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-fa03ce31-4a70-42ab-a5f8-fb5bd4cd0383 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:32.824345 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-b0c0bbe9-e31a-4334-8f0b-4848f90cbddf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:32.833242 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-b0c0bbe9-e31a-4334-8f0b-4848f90cbddf tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.202534 May 17 17:16:32.845284 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 423/876] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:32 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:32.960600 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-fa03ce31-4a70-42ab-a5f8-fb5bd4cd0383 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:32.969812 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-fa03ce31-4a70-42ab-a5f8-fb5bd4cd0383 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:32.971306 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-fa03ce31-4a70-42ab-a5f8-fb5bd4cd0383 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:32.972489 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-fa03ce31-4a70-42ab-a5f8-fb5bd4cd0383 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1674 microversion: 2.20 time: 0.178817 May 17 17:16:32.973153 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 454/877] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:32 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:33.795966 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-5cc218e9-9f9a-4e2d-9cdf-11117b1d4d9a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:33.796744 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-5cc218e9-9f9a-4e2d-9cdf-11117b1d4d9a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:33.803040 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5cc218e9-9f9a-4e2d-9cdf-11117b1d4d9a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:33.803496 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5cc218e9-9f9a-4e2d-9cdf-11117b1d4d9a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:33.804329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5cc218e9-9f9a-4e2d-9cdf-11117b1d4d9a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:33.804770 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5cc218e9-9f9a-4e2d-9cdf-11117b1d4d9a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:33.853664 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-40086f58-e5ae-4184-9d9e-38dc4fe15484 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:33.854613 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-40086f58-e5ae-4184-9d9e-38dc4fe15484 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:33.860872 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-40086f58-e5ae-4184-9d9e-38dc4fe15484 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:33.861326 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-40086f58-e5ae-4184-9d9e-38dc4fe15484 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:33.862107 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-40086f58-e5ae-4184-9d9e-38dc4fe15484 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:33.862547 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-40086f58-e5ae-4184-9d9e-38dc4fe15484 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:33.989713 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5cc218e9-9f9a-4e2d-9cdf-11117b1d4d9a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:33.997915 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-5cc218e9-9f9a-4e2d-9cdf-11117b1d4d9a tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.205759 May 17 17:16:33.998498 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 424/878] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:33 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:34.003038 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4238a70b-7470-42c8-80d8-bba22d776257 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:34.003954 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4238a70b-7470-42c8-80d8-bba22d776257 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:34.012470 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4238a70b-7470-42c8-80d8-bba22d776257 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:34.012925 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4238a70b-7470-42c8-80d8-bba22d776257 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:34.013737 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4238a70b-7470-42c8-80d8-bba22d776257 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:34.014180 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4238a70b-7470-42c8-80d8-bba22d776257 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:34.040980 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-40086f58-e5ae-4184-9d9e-38dc4fe15484 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:34.048825 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-40086f58-e5ae-4184-9d9e-38dc4fe15484 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.199682 May 17 17:16:34.058560 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 455/879] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:33 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:34.150747 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4238a70b-7470-42c8-80d8-bba22d776257 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:34.158806 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4238a70b-7470-42c8-80d8-bba22d776257 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:34.160329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4238a70b-7470-42c8-80d8-bba22d776257 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:34.161478 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4238a70b-7470-42c8-80d8-bba22d776257 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.162065 May 17 17:16:34.162031 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 425/880] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:33 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:35.016886 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f039af48-9792-4e23-a279-0d599c464e6c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:35.018608 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f039af48-9792-4e23-a279-0d599c464e6c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:35.028611 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f039af48-9792-4e23-a279-0d599c464e6c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:35.029488 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f039af48-9792-4e23-a279-0d599c464e6c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:35.030548 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f039af48-9792-4e23-a279-0d599c464e6c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:35.031361 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f039af48-9792-4e23-a279-0d599c464e6c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:35.066295 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-02b2e40d-f37e-4297-b3db-28ea296ba78e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:35.067645 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-02b2e40d-f37e-4297-b3db-28ea296ba78e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:35.074896 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-02b2e40d-f37e-4297-b3db-28ea296ba78e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:35.075751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-02b2e40d-f37e-4297-b3db-28ea296ba78e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:35.076790 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-02b2e40d-f37e-4297-b3db-28ea296ba78e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:35.077460 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-02b2e40d-f37e-4297-b3db-28ea296ba78e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:35.249625 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-02b2e40d-f37e-4297-b3db-28ea296ba78e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:35.257212 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-02b2e40d-f37e-4297-b3db-28ea296ba78e tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.194710 May 17 17:16:35.266997 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 426/881] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:35 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:16:35.266997 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-71a8fd43-ce9c-4ade-88a9-51a8ff2b2617 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:35.267784 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-71a8fd43-ce9c-4ade-88a9-51a8ff2b2617 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:35.275245 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-71a8fd43-ce9c-4ade-88a9-51a8ff2b2617 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:35.276147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-71a8fd43-ce9c-4ade-88a9-51a8ff2b2617 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:35.278512 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-71a8fd43-ce9c-4ade-88a9-51a8ff2b2617 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:35.279301 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-71a8fd43-ce9c-4ade-88a9-51a8ff2b2617 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:35.442909 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f039af48-9792-4e23-a279-0d599c464e6c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:35.448093 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f039af48-9792-4e23-a279-0d599c464e6c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.432752 May 17 17:16:35.448561 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 456/882] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:35 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:35.479578 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-71a8fd43-ce9c-4ade-88a9-51a8ff2b2617 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:35.487489 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-71a8fd43-ce9c-4ade-88a9-51a8ff2b2617 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:35.489030 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-71a8fd43-ce9c-4ade-88a9-51a8ff2b2617 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:35.490233 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-71a8fd43-ce9c-4ade-88a9-51a8ff2b2617 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.227877 May 17 17:16:35.490807 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 427/883] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:35 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:36.274649 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5809f568-5bb8-420e-adb6-5266a6ecab7b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:36.275477 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5809f568-5bb8-420e-adb6-5266a6ecab7b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:36.281908 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5809f568-5bb8-420e-adb6-5266a6ecab7b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:36.282395 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5809f568-5bb8-420e-adb6-5266a6ecab7b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:36.283111 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5809f568-5bb8-420e-adb6-5266a6ecab7b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:36.283594 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5809f568-5bb8-420e-adb6-5266a6ecab7b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:36.467102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4c50269f-0879-4859-a056-f8fc4346008c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:36.468022 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4c50269f-0879-4859-a056-f8fc4346008c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:36.483579 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c50269f-0879-4859-a056-f8fc4346008c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:36.484355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c50269f-0879-4859-a056-f8fc4346008c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:36.485293 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c50269f-0879-4859-a056-f8fc4346008c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:36.485896 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c50269f-0879-4859-a056-f8fc4346008c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:36.496160 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5809f568-5bb8-420e-adb6-5266a6ecab7b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:36.506787 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5809f568-5bb8-420e-adb6-5266a6ecab7b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.236334 May 17 17:16:36.518791 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 457/884] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:36 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:36.526188 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3295d7e7-dcae-455c-a2df-452621523be5 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:36.527086 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-3295d7e7-dcae-455c-a2df-452621523be5 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:36.534844 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3295d7e7-dcae-455c-a2df-452621523be5 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:36.535637 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3295d7e7-dcae-455c-a2df-452621523be5 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:36.537520 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3295d7e7-dcae-455c-a2df-452621523be5 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:36.538138 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3295d7e7-dcae-455c-a2df-452621523be5 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:36.788584 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-3295d7e7-dcae-455c-a2df-452621523be5 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:36.803595 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-3295d7e7-dcae-455c-a2df-452621523be5 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:36.809574 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-3295d7e7-dcae-455c-a2df-452621523be5 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:36.810782 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-3295d7e7-dcae-455c-a2df-452621523be5 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.290339 May 17 17:16:36.811336 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 458/885] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:36 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:36.858500 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4c50269f-0879-4859-a056-f8fc4346008c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:36.870049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4c50269f-0879-4859-a056-f8fc4346008c tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.406706 May 17 17:16:36.880197 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 428/886] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:36 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:37.526466 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-737df3e8-6888-46cd-9b15-f19635dbc565 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:37.527922 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-737df3e8-6888-46cd-9b15-f19635dbc565 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:37.536105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-737df3e8-6888-46cd-9b15-f19635dbc565 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:37.536557 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-737df3e8-6888-46cd-9b15-f19635dbc565 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:37.537357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-737df3e8-6888-46cd-9b15-f19635dbc565 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:37.537785 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-737df3e8-6888-46cd-9b15-f19635dbc565 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:37.706340 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-737df3e8-6888-46cd-9b15-f19635dbc565 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:37.715899 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-737df3e8-6888-46cd-9b15-f19635dbc565 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.194298 May 17 17:16:37.717643 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 459/887] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:37 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:37.830814 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-80ae1622-7183-4548-a6bf-0ea670355b18 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:37.831443 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-80ae1622-7183-4548-a6bf-0ea670355b18 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:37.838493 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80ae1622-7183-4548-a6bf-0ea670355b18 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:37.840164 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80ae1622-7183-4548-a6bf-0ea670355b18 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:37.841135 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80ae1622-7183-4548-a6bf-0ea670355b18 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:37.841736 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80ae1622-7183-4548-a6bf-0ea670355b18 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:37.891510 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-45f84a98-6bfd-4f8e-b5f6-8e574d32ab70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:37.892323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-45f84a98-6bfd-4f8e-b5f6-8e574d32ab70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:37.905564 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-45f84a98-6bfd-4f8e-b5f6-8e574d32ab70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:37.907372 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-45f84a98-6bfd-4f8e-b5f6-8e574d32ab70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:37.910038 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-45f84a98-6bfd-4f8e-b5f6-8e574d32ab70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:37.910657 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-45f84a98-6bfd-4f8e-b5f6-8e574d32ab70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:38.135461 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-80ae1622-7183-4548-a6bf-0ea670355b18 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:38.145374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-80ae1622-7183-4548-a6bf-0ea670355b18 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:38.146880 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-80ae1622-7183-4548-a6bf-0ea670355b18 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:38.151968 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-80ae1622-7183-4548-a6bf-0ea670355b18 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.325656 May 17 17:16:38.160087 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 429/888] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:37 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:38.168231 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-45f84a98-6bfd-4f8e-b5f6-8e574d32ab70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:38.177887 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-45f84a98-6bfd-4f8e-b5f6-8e574d32ab70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.291952 May 17 17:16:38.178964 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 460/889] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:37 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:38.629403 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-e3960ef4-bb54-4f12-8447-d0ee980fd186 req-93ebf9c7-32e6-414a-9be0-8a26a7090005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b233a28b-810a-4304-a7cb-93b1c24f76fe", "name": "network-vif-plugged", "status": "completed", "tag": "791f659d-31d5-4dc2-b5c3-e9c1d9bd7f25"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:38.659400 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-e3960ef4-bb54-4f12-8447-d0ee980fd186 req-93ebf9c7-32e6-414a-9be0-8a26a7090005 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:38.659885 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-e3960ef4-bb54-4f12-8447-d0ee980fd186 req-93ebf9c7-32e6-414a-9be0-8a26a7090005 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:38.676657 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-e3960ef4-bb54-4f12-8447-d0ee980fd186 req-93ebf9c7-32e6-414a-9be0-8a26a7090005 service nova] Creating event network-vif-plugged:791f659d-31d5-4dc2-b5c3-e9c1d9bd7f25 for instance b233a28b-810a-4304-a7cb-93b1c24f76fe on hv-cinder-84214 May 17 17:16:38.682247 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-e3960ef4-bb54-4f12-8447-d0ee980fd186 req-93ebf9c7-32e6-414a-9be0-8a26a7090005 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063214 May 17 17:16:38.683538 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 430/890] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:38.739660 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8e5cc0b7-a0f6-44b3-8152-e4f570ea54f7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:38.740273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8e5cc0b7-a0f6-44b3-8152-e4f570ea54f7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:38.754247 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8e5cc0b7-a0f6-44b3-8152-e4f570ea54f7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:38.754974 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8e5cc0b7-a0f6-44b3-8152-e4f570ea54f7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:38.756061 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8e5cc0b7-a0f6-44b3-8152-e4f570ea54f7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:38.757411 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8e5cc0b7-a0f6-44b3-8152-e4f570ea54f7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:38.968848 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8e5cc0b7-a0f6-44b3-8152-e4f570ea54f7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:38.976801 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8e5cc0b7-a0f6-44b3-8152-e4f570ea54f7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.246726 May 17 17:16:38.977955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 461/891] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:38 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:39.178487 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f7ee3880-e05c-4189-a49c-62d58c1a63b4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:39.179188 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f7ee3880-e05c-4189-a49c-62d58c1a63b4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:39.187507 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f7ee3880-e05c-4189-a49c-62d58c1a63b4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:39.187992 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f7ee3880-e05c-4189-a49c-62d58c1a63b4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:39.188760 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f7ee3880-e05c-4189-a49c-62d58c1a63b4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:39.189197 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f7ee3880-e05c-4189-a49c-62d58c1a63b4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:39.197233 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-eae5e535-20b2-4cb6-8fb8-a6b0dbfbdc70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:39.198381 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-eae5e535-20b2-4cb6-8fb8-a6b0dbfbdc70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:39.208932 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-eae5e535-20b2-4cb6-8fb8-a6b0dbfbdc70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:39.209381 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-eae5e535-20b2-4cb6-8fb8-a6b0dbfbdc70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:39.210170 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-eae5e535-20b2-4cb6-8fb8-a6b0dbfbdc70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:39.210622 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-eae5e535-20b2-4cb6-8fb8-a6b0dbfbdc70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:39.424134 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f7ee3880-e05c-4189-a49c-62d58c1a63b4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:39.437381 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f7ee3880-e05c-4189-a49c-62d58c1a63b4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:39.443331 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f7ee3880-e05c-4189-a49c-62d58c1a63b4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:39.447457 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f7ee3880-e05c-4189-a49c-62d58c1a63b4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.273149 May 17 17:16:39.452735 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 431/892] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:39 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:39.471706 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-eae5e535-20b2-4cb6-8fb8-a6b0dbfbdc70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:39.484249 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-eae5e535-20b2-4cb6-8fb8-a6b0dbfbdc70 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.290886 May 17 17:16:39.485152 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 462/893] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:39 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:16:39.994839 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f303afde-312d-4766-8eb1-00a83d25da4d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:39.995361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f303afde-312d-4766-8eb1-00a83d25da4d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:40.001663 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f303afde-312d-4766-8eb1-00a83d25da4d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:40.002113 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f303afde-312d-4766-8eb1-00a83d25da4d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:40.002892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f303afde-312d-4766-8eb1-00a83d25da4d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:40.003577 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f303afde-312d-4766-8eb1-00a83d25da4d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:40.151230 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f303afde-312d-4766-8eb1-00a83d25da4d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:40.158990 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f303afde-312d-4766-8eb1-00a83d25da4d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.168437 May 17 17:16:40.159652 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 432/894] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:39 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:40.474996 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-90ee36dc-17ba-42bb-b6bf-2a8d06bfc827 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:40.477357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-90ee36dc-17ba-42bb-b6bf-2a8d06bfc827 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:40.484939 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90ee36dc-17ba-42bb-b6bf-2a8d06bfc827 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:40.485540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90ee36dc-17ba-42bb-b6bf-2a8d06bfc827 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:40.486571 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90ee36dc-17ba-42bb-b6bf-2a8d06bfc827 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:40.487101 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-90ee36dc-17ba-42bb-b6bf-2a8d06bfc827 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:40.503692 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ecbdee86-870f-4d87-88ae-9ef962e84e67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:40.504687 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ecbdee86-870f-4d87-88ae-9ef962e84e67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:40.511763 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ecbdee86-870f-4d87-88ae-9ef962e84e67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:40.512320 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ecbdee86-870f-4d87-88ae-9ef962e84e67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:40.513334 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ecbdee86-870f-4d87-88ae-9ef962e84e67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:40.514087 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ecbdee86-870f-4d87-88ae-9ef962e84e67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:40.707587 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-90ee36dc-17ba-42bb-b6bf-2a8d06bfc827 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:40.713310 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ecbdee86-870f-4d87-88ae-9ef962e84e67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:40.724176 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ecbdee86-870f-4d87-88ae-9ef962e84e67 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.225621 May 17 17:16:40.727933 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-90ee36dc-17ba-42bb-b6bf-2a8d06bfc827 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:40.729487 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-90ee36dc-17ba-42bb-b6bf-2a8d06bfc827 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:40.730129 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 433/895] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:40 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:40.731163 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-90ee36dc-17ba-42bb-b6bf-2a8d06bfc827 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.261501 May 17 17:16:40.740401 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 463/896] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:40 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:16:41.177489 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-eae97823-58a9-47b5-8f78-00f900084db0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:41.178114 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-eae97823-58a9-47b5-8f78-00f900084db0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:41.184687 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eae97823-58a9-47b5-8f78-00f900084db0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:41.185151 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eae97823-58a9-47b5-8f78-00f900084db0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:41.185934 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eae97823-58a9-47b5-8f78-00f900084db0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:41.186764 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eae97823-58a9-47b5-8f78-00f900084db0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:41.339997 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-eae97823-58a9-47b5-8f78-00f900084db0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:41.347822 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-eae97823-58a9-47b5-8f78-00f900084db0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.174562 May 17 17:16:41.348409 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 434/897] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:41 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:41.749680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1610457c-e62a-4cce-8ebb-88ef495b87c3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:41.754906 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8d30b09b-9387-4c40-ab2d-3d896cb5517d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:41.755870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8d30b09b-9387-4c40-ab2d-3d896cb5517d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:41.761262 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1610457c-e62a-4cce-8ebb-88ef495b87c3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:41.764743 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8d30b09b-9387-4c40-ab2d-3d896cb5517d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:41.765251 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8d30b09b-9387-4c40-ab2d-3d896cb5517d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:41.766243 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8d30b09b-9387-4c40-ab2d-3d896cb5517d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:41.766689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8d30b09b-9387-4c40-ab2d-3d896cb5517d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:41.774708 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1610457c-e62a-4cce-8ebb-88ef495b87c3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:41.775155 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1610457c-e62a-4cce-8ebb-88ef495b87c3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:41.775960 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1610457c-e62a-4cce-8ebb-88ef495b87c3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:41.776513 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1610457c-e62a-4cce-8ebb-88ef495b87c3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:41.980203 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8d30b09b-9387-4c40-ab2d-3d896cb5517d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:41.987879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8d30b09b-9387-4c40-ab2d-3d896cb5517d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.242943 May 17 17:16:41.988449 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 464/898] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:41 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:41.994566 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1610457c-e62a-4cce-8ebb-88ef495b87c3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:42.003481 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1610457c-e62a-4cce-8ebb-88ef495b87c3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:42.005064 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1610457c-e62a-4cce-8ebb-88ef495b87c3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:42.006518 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1610457c-e62a-4cce-8ebb-88ef495b87c3 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.261265 May 17 17:16:42.007152 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 435/899] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:41 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:42.366838 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-69b91b54-1a92-4633-98c0-fdf79211bb40 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:42.368202 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-69b91b54-1a92-4633-98c0-fdf79211bb40 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:42.374916 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-69b91b54-1a92-4633-98c0-fdf79211bb40 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:42.375672 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-69b91b54-1a92-4633-98c0-fdf79211bb40 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:42.376638 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-69b91b54-1a92-4633-98c0-fdf79211bb40 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:42.377240 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-69b91b54-1a92-4633-98c0-fdf79211bb40 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:42.524327 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-69b91b54-1a92-4633-98c0-fdf79211bb40 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:42.533841 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-69b91b54-1a92-4633-98c0-fdf79211bb40 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.172275 May 17 17:16:42.542038 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 465/900] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:42 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:43.008579 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-15b7eb06-94b8-4dfe-b24c-57d206d94429 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:43.009254 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-15b7eb06-94b8-4dfe-b24c-57d206d94429 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:43.015479 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-15b7eb06-94b8-4dfe-b24c-57d206d94429 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:43.015958 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-15b7eb06-94b8-4dfe-b24c-57d206d94429 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:43.016716 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-15b7eb06-94b8-4dfe-b24c-57d206d94429 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:43.017152 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-15b7eb06-94b8-4dfe-b24c-57d206d94429 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:43.025459 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8211bf67-dc44-4f92-aaff-c43fe560687c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:43.026123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8211bf67-dc44-4f92-aaff-c43fe560687c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:43.033955 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8211bf67-dc44-4f92-aaff-c43fe560687c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:43.034735 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8211bf67-dc44-4f92-aaff-c43fe560687c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:43.035777 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8211bf67-dc44-4f92-aaff-c43fe560687c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:43.036296 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8211bf67-dc44-4f92-aaff-c43fe560687c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:43.279676 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-15b7eb06-94b8-4dfe-b24c-57d206d94429 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:43.285845 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8211bf67-dc44-4f92-aaff-c43fe560687c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:43.287076 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-15b7eb06-94b8-4dfe-b24c-57d206d94429 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.282267 May 17 17:16:43.287881 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 436/901] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:43 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:43.294687 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8211bf67-dc44-4f92-aaff-c43fe560687c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:43.296252 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8211bf67-dc44-4f92-aaff-c43fe560687c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:43.297471 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8211bf67-dc44-4f92-aaff-c43fe560687c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.276064 May 17 17:16:43.298023 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 466/902] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:43 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:16:43.771816 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3fa297b5-cae7-4a90-87f8-697bee13335c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:43.772519 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3fa297b5-cae7-4a90-87f8-697bee13335c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:43.779354 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3fa297b5-cae7-4a90-87f8-697bee13335c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:43.779919 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3fa297b5-cae7-4a90-87f8-697bee13335c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:43.780765 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3fa297b5-cae7-4a90-87f8-697bee13335c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:43.781273 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3fa297b5-cae7-4a90-87f8-697bee13335c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:43.921921 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3fa297b5-cae7-4a90-87f8-697bee13335c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:43.930056 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3fa297b5-cae7-4a90-87f8-697bee13335c tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.381948 May 17 17:16:43.930665 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 437/903] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:43 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:44.303503 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9cbc31c7-8cc8-4ac7-a9e3-de85913381cf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:44.304149 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9cbc31c7-8cc8-4ac7-a9e3-de85913381cf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:44.310845 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9cbc31c7-8cc8-4ac7-a9e3-de85913381cf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:44.311300 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9cbc31c7-8cc8-4ac7-a9e3-de85913381cf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:44.312109 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9cbc31c7-8cc8-4ac7-a9e3-de85913381cf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:44.312540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9cbc31c7-8cc8-4ac7-a9e3-de85913381cf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:44.316272 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-537ade30-3920-49cf-9f88-c607cddcf799 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:44.317023 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-537ade30-3920-49cf-9f88-c607cddcf799 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:44.324146 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-537ade30-3920-49cf-9f88-c607cddcf799 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:44.324531 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-537ade30-3920-49cf-9f88-c607cddcf799 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:44.325281 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-537ade30-3920-49cf-9f88-c607cddcf799 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:44.325723 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-537ade30-3920-49cf-9f88-c607cddcf799 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:44.515117 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9cbc31c7-8cc8-4ac7-a9e3-de85913381cf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:44.518404 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-537ade30-3920-49cf-9f88-c607cddcf799 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:44.523295 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9cbc31c7-8cc8-4ac7-a9e3-de85913381cf tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.223554 May 17 17:16:44.524211 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 467/904] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:44 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:44.531183 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-537ade30-3920-49cf-9f88-c607cddcf799 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:44.533515 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-537ade30-3920-49cf-9f88-c607cddcf799 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:44.534701 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-537ade30-3920-49cf-9f88-c607cddcf799 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.222380 May 17 17:16:44.535448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 438/905] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:44 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:44.947883 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-452bb78e-fa41-40e9-8025-9955f399bf0f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:44.948492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-452bb78e-fa41-40e9-8025-9955f399bf0f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:44.954631 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-452bb78e-fa41-40e9-8025-9955f399bf0f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:44.955075 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-452bb78e-fa41-40e9-8025-9955f399bf0f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:44.955867 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-452bb78e-fa41-40e9-8025-9955f399bf0f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:44.956300 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-452bb78e-fa41-40e9-8025-9955f399bf0f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:45.100518 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-452bb78e-fa41-40e9-8025-9955f399bf0f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:45.108729 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-452bb78e-fa41-40e9-8025-9955f399bf0f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.165291 May 17 17:16:45.109291 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 468/906] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:44 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:45.542609 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-28032d24-69cb-4072-a6a7-f36b1e71fa42 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:45.543308 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-28032d24-69cb-4072-a6a7-f36b1e71fa42 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:45.549746 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-28032d24-69cb-4072-a6a7-f36b1e71fa42 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:45.550379 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-28032d24-69cb-4072-a6a7-f36b1e71fa42 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:45.551357 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-28032d24-69cb-4072-a6a7-f36b1e71fa42 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:45.551889 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-28032d24-69cb-4072-a6a7-f36b1e71fa42 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:45.554406 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ca3337b1-df03-42c4-a2af-4a3f7a64c5f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:45.555046 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ca3337b1-df03-42c4-a2af-4a3f7a64c5f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:45.562764 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca3337b1-df03-42c4-a2af-4a3f7a64c5f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:45.563374 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca3337b1-df03-42c4-a2af-4a3f7a64c5f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:45.564275 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca3337b1-df03-42c4-a2af-4a3f7a64c5f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:45.564712 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ca3337b1-df03-42c4-a2af-4a3f7a64c5f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:45.756830 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-28032d24-69cb-4072-a6a7-f36b1e71fa42 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:45.761189 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ca3337b1-df03-42c4-a2af-4a3f7a64c5f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:45.765431 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-28032d24-69cb-4072-a6a7-f36b1e71fa42 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.227806 May 17 17:16:45.769300 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ca3337b1-df03-42c4-a2af-4a3f7a64c5f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:45.770894 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ca3337b1-df03-42c4-a2af-4a3f7a64c5f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:45.772141 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ca3337b1-df03-42c4-a2af-4a3f7a64c5f4 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.222154 May 17 17:16:45.776485 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 439/907] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:45 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:45.783418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 469/908] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:45 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:46.127995 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-88aad157-af5c-43a5-9282-44816dfd9bac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:46.128620 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-88aad157-af5c-43a5-9282-44816dfd9bac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:46.140005 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-88aad157-af5c-43a5-9282-44816dfd9bac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:46.140990 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-88aad157-af5c-43a5-9282-44816dfd9bac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:46.142655 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-88aad157-af5c-43a5-9282-44816dfd9bac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:46.143102 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-88aad157-af5c-43a5-9282-44816dfd9bac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:46.224091 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-0c9c651d-249b-4133-aede-108886607020 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:46.225090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-0c9c651d-249b-4133-aede-108886607020 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:46.231690 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0c9c651d-249b-4133-aede-108886607020 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:46.232138 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0c9c651d-249b-4133-aede-108886607020 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:46.233123 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0c9c651d-249b-4133-aede-108886607020 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:46.233559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0c9c651d-249b-4133-aede-108886607020 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:46.264991 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-0c9c651d-249b-4133-aede-108886607020 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 May 17 17:16:46.265742 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 470/909] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:16:46 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:16:46.275529 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ff3d74ae-0fa0-4b32-92f2-0bdc24959a7a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:46.276049 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ff3d74ae-0fa0-4b32-92f2-0bdc24959a7a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:46.282767 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ff3d74ae-0fa0-4b32-92f2-0bdc24959a7a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:46.283221 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ff3d74ae-0fa0-4b32-92f2-0bdc24959a7a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:46.284041 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ff3d74ae-0fa0-4b32-92f2-0bdc24959a7a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:46.284471 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ff3d74ae-0fa0-4b32-92f2-0bdc24959a7a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:46.304786 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-88aad157-af5c-43a5-9282-44816dfd9bac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:46.315154 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-88aad157-af5c-43a5-9282-44816dfd9bac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.192882 May 17 17:16:46.315817 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 440/910] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:46 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:46.316491 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ff3d74ae-0fa0-4b32-92f2-0bdc24959a7a tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments/6ca6a66c-eab6-4007-913e-e676adcd778e" status: 200 len: 194 microversion: 2.1 time: 0.044872 May 17 17:16:46.317265 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 471/911] 10.222.0.48 () {58 vars in 1412 bytes} [Tue May 17 17:16:46 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments/6ca6a66c-eab6-4007-913e-e676adcd778e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:16:46.784585 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6af5f78b-d08e-48b8-bc0c-29893cedc174 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:46.785257 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6af5f78b-d08e-48b8-bc0c-29893cedc174 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:46.790323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1aae2615-f16a-4317-b075-cb8daf68d31f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:46.790949 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1aae2615-f16a-4317-b075-cb8daf68d31f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:46.791983 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6af5f78b-d08e-48b8-bc0c-29893cedc174 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:46.792438 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6af5f78b-d08e-48b8-bc0c-29893cedc174 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:46.793202 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6af5f78b-d08e-48b8-bc0c-29893cedc174 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:46.793796 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6af5f78b-d08e-48b8-bc0c-29893cedc174 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:46.797531 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1aae2615-f16a-4317-b075-cb8daf68d31f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:46.798137 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1aae2615-f16a-4317-b075-cb8daf68d31f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:46.799125 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1aae2615-f16a-4317-b075-cb8daf68d31f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:46.799561 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1aae2615-f16a-4317-b075-cb8daf68d31f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:47.004856 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6af5f78b-d08e-48b8-bc0c-29893cedc174 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:47.007898 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1aae2615-f16a-4317-b075-cb8daf68d31f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:47.015459 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6af5f78b-d08e-48b8-bc0c-29893cedc174 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.235104 May 17 17:16:47.016541 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 441/912] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:46 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:47.021971 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1aae2615-f16a-4317-b075-cb8daf68d31f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:47.024969 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1aae2615-f16a-4317-b075-cb8daf68d31f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:47.026472 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1aae2615-f16a-4317-b075-cb8daf68d31f tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.240131 May 17 17:16:47.027528 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 472/913] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:46 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:47.333221 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8c718155-e9b6-481c-9cb4-d7f139c0d3c2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:47.333846 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8c718155-e9b6-481c-9cb4-d7f139c0d3c2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:47.340408 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8c718155-e9b6-481c-9cb4-d7f139c0d3c2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:47.340864 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8c718155-e9b6-481c-9cb4-d7f139c0d3c2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:47.341636 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8c718155-e9b6-481c-9cb4-d7f139c0d3c2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:47.342080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8c718155-e9b6-481c-9cb4-d7f139c0d3c2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:47.478889 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-8c718155-e9b6-481c-9cb4-d7f139c0d3c2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:47.486220 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8c718155-e9b6-481c-9cb4-d7f139c0d3c2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1366 microversion: 2.1 time: 0.156993 May 17 17:16:47.486784 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 442/914] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:47 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:47.672343 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b7a678b7-c234-429c-8031-74efce08a906 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d365135a-0f87-4aa1-b8fa-750f126e28b7"}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:47.673410 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b7a678b7-c234-429c-8031-74efce08a906 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:47.679148 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b7a678b7-c234-429c-8031-74efce08a906 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:47.679591 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b7a678b7-c234-429c-8031-74efce08a906 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:47.680369 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b7a678b7-c234-429c-8031-74efce08a906 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:47.681029 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b7a678b7-c234-429c-8031-74efce08a906 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:47.904226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b7a678b7-c234-429c-8031-74efce08a906 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "POST /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.235351 May 17 17:16:47.904908 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 473/915] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 17 17:16:47 2022] POST /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments => generated 194 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:48.033433 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e2c5f2a7-75e3-4c44-b7cc-3af0da1e847d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:48.034048 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e2c5f2a7-75e3-4c44-b7cc-3af0da1e847d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:48.041401 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e2c5f2a7-75e3-4c44-b7cc-3af0da1e847d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:48.042069 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e2c5f2a7-75e3-4c44-b7cc-3af0da1e847d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:48.042845 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e2c5f2a7-75e3-4c44-b7cc-3af0da1e847d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:48.043283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e2c5f2a7-75e3-4c44-b7cc-3af0da1e847d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:48.046128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-230dfbee-251d-4bbf-9edb-4b06936ed97d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:48.046878 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-230dfbee-251d-4bbf-9edb-4b06936ed97d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:48.053987 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-230dfbee-251d-4bbf-9edb-4b06936ed97d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:48.054510 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-230dfbee-251d-4bbf-9edb-4b06936ed97d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:48.055280 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-230dfbee-251d-4bbf-9edb-4b06936ed97d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:48.056413 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-230dfbee-251d-4bbf-9edb-4b06936ed97d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:48.244432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e2c5f2a7-75e3-4c44-b7cc-3af0da1e847d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:48.247938 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-230dfbee-251d-4bbf-9edb-4b06936ed97d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:48.252475 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e2c5f2a7-75e3-4c44-b7cc-3af0da1e847d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.222789 May 17 17:16:48.253217 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 443/916] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:48 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:48.267971 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-230dfbee-251d-4bbf-9edb-4b06936ed97d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:48.269509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-230dfbee-251d-4bbf-9edb-4b06936ed97d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:48.270770 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-230dfbee-251d-4bbf-9edb-4b06936ed97d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.229050 May 17 17:16:48.271398 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 474/917] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:48 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:16:48.504429 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8c873fa0-5753-4792-9852-0bc76a420bc2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:48.505176 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8c873fa0-5753-4792-9852-0bc76a420bc2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:48.512762 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8c873fa0-5753-4792-9852-0bc76a420bc2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:48.513480 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8c873fa0-5753-4792-9852-0bc76a420bc2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:48.514295 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8c873fa0-5753-4792-9852-0bc76a420bc2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:48.514809 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8c873fa0-5753-4792-9852-0bc76a420bc2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:48.646873 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-8c873fa0-5753-4792-9852-0bc76a420bc2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:48.655079 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8c873fa0-5753-4792-9852-0bc76a420bc2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1556 microversion: 2.1 time: 0.154854 May 17 17:16:48.655657 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 444/918] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:48 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:48.672072 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-bf4ef0fd-0076-48af-88f1-30536e5d00e9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:48.672575 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-bf4ef0fd-0076-48af-88f1-30536e5d00e9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:48.678856 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf4ef0fd-0076-48af-88f1-30536e5d00e9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:48.679311 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf4ef0fd-0076-48af-88f1-30536e5d00e9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:48.680109 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf4ef0fd-0076-48af-88f1-30536e5d00e9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:48.680545 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf4ef0fd-0076-48af-88f1-30536e5d00e9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:48.756973 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-bf4ef0fd-0076-48af-88f1-30536e5d00e9 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088677 May 17 17:16:48.757563 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 475/919] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 17 17:16:48 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:48.780335 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-198c69b3-85d8-4fb2-ab79-46b6fd896790 req-6921bb0c-854d-4730-910e-ed7e441e7d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d1426b-07f8-410e-b753-b1d8e9c1102f", "name": "network-vif-plugged", "status": "completed", "tag": "72213c8f-95d2-4e6b-bc71-ec5cf8e62273"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:48.790751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-198c69b3-85d8-4fb2-ab79-46b6fd896790 req-6921bb0c-854d-4730-910e-ed7e441e7d45 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:48.792486 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-198c69b3-85d8-4fb2-ab79-46b6fd896790 req-6921bb0c-854d-4730-910e-ed7e441e7d45 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:48.810934 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-198c69b3-85d8-4fb2-ab79-46b6fd896790 req-6921bb0c-854d-4730-910e-ed7e441e7d45 service nova] Creating event network-vif-plugged:72213c8f-95d2-4e6b-bc71-ec5cf8e62273 for instance 47d1426b-07f8-410e-b753-b1d8e9c1102f on hv-cinder-84214 May 17 17:16:48.816397 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-198c69b3-85d8-4fb2-ab79-46b6fd896790 req-6921bb0c-854d-4730-910e-ed7e441e7d45 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040826 May 17 17:16:48.817290 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 445/920] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:49.270788 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-870bcb53-4f57-41a0-97db-8d3764310d8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:49.271346 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-870bcb53-4f57-41a0-97db-8d3764310d8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:49.278042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-870bcb53-4f57-41a0-97db-8d3764310d8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:49.278490 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-870bcb53-4f57-41a0-97db-8d3764310d8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:49.279248 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-870bcb53-4f57-41a0-97db-8d3764310d8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:49.279705 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-870bcb53-4f57-41a0-97db-8d3764310d8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:49.290945 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ef9a7448-1a2f-4790-bb9f-0d1fe9ec1903 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:49.292195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ef9a7448-1a2f-4790-bb9f-0d1fe9ec1903 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:49.299339 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ef9a7448-1a2f-4790-bb9f-0d1fe9ec1903 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:49.300038 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ef9a7448-1a2f-4790-bb9f-0d1fe9ec1903 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:49.300934 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ef9a7448-1a2f-4790-bb9f-0d1fe9ec1903 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:49.301376 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ef9a7448-1a2f-4790-bb9f-0d1fe9ec1903 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:49.795508 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-870bcb53-4f57-41a0-97db-8d3764310d8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:49.803160 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-870bcb53-4f57-41a0-97db-8d3764310d8d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1574 microversion: 2.1 time: 0.536769 May 17 17:16:49.804089 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 476/921] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:49 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1574 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:49.812289 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ef9a7448-1a2f-4790-bb9f-0d1fe9ec1903 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:49.821060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ef9a7448-1a2f-4790-bb9f-0d1fe9ec1903 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:49.822734 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ef9a7448-1a2f-4790-bb9f-0d1fe9ec1903 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:49.824296 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ef9a7448-1a2f-4790-bb9f-0d1fe9ec1903 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.537777 May 17 17:16:49.824983 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 446/922] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:49 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:16:50.291530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-bb65f575-ec30-4159-aef5-004f35062190 req-64f69fbe-271e-49b3-b015-8ef0bd1d0dfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b233a28b-810a-4304-a7cb-93b1c24f76fe", "tag": "791f659d-31d5-4dc2-b5c3-e9c1d9bd7f25"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:50.301552 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-bb65f575-ec30-4159-aef5-004f35062190 req-64f69fbe-271e-49b3-b015-8ef0bd1d0dfb service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:50.301989 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-bb65f575-ec30-4159-aef5-004f35062190 req-64f69fbe-271e-49b3-b015-8ef0bd1d0dfb service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:50.315292 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-bb65f575-ec30-4159-aef5-004f35062190 req-64f69fbe-271e-49b3-b015-8ef0bd1d0dfb service nova] Creating event network-changed:791f659d-31d5-4dc2-b5c3-e9c1d9bd7f25 for instance b233a28b-810a-4304-a7cb-93b1c24f76fe on hv-cinder-84214 May 17 17:16:50.320855 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-bb65f575-ec30-4159-aef5-004f35062190 req-64f69fbe-271e-49b3-b015-8ef0bd1d0dfb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232793 May 17 17:16:50.321817 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 477/923] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:50.822089 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a6824289-2c59-4174-82d3-6b82d251d9f6 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:50.823247 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a6824289-2c59-4174-82d3-6b82d251d9f6 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:50.829736 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a6824289-2c59-4174-82d3-6b82d251d9f6 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:50.830424 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a6824289-2c59-4174-82d3-6b82d251d9f6 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:50.831386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a6824289-2c59-4174-82d3-6b82d251d9f6 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:50.832192 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a6824289-2c59-4174-82d3-6b82d251d9f6 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:50.841255 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-380fdb47-6030-46cf-b2e1-79c35ce2daf2 req-41ef3e72-1d64-4f85-9de9-522469559270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6de88f8-538f-45eb-bfcd-fce744a5c55d", "name": "network-vif-plugged", "status": "completed", "tag": "e349ab19-ab43-4bf5-8128-4ce8f8b7a5f5"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:16:50.855378 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-380fdb47-6030-46cf-b2e1-79c35ce2daf2 req-41ef3e72-1d64-4f85-9de9-522469559270 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:50.862332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-380fdb47-6030-46cf-b2e1-79c35ce2daf2 req-41ef3e72-1d64-4f85-9de9-522469559270 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:50.875515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-380fdb47-6030-46cf-b2e1-79c35ce2daf2 req-41ef3e72-1d64-4f85-9de9-522469559270 service nova] Creating event network-vif-plugged:e349ab19-ab43-4bf5-8128-4ce8f8b7a5f5 for instance b6de88f8-538f-45eb-bfcd-fce744a5c55d on hv-cinder-84214 May 17 17:16:50.882176 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-380fdb47-6030-46cf-b2e1-79c35ce2daf2 req-41ef3e72-1d64-4f85-9de9-522469559270 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046243 May 17 17:16:50.884156 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 478/924] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:16:50.893464 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-bf5c259b-b81c-4af0-be5a-49d4b87b9704 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:50.894443 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-bf5c259b-b81c-4af0-be5a-49d4b87b9704 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:50.902290 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf5c259b-b81c-4af0-be5a-49d4b87b9704 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:50.903428 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf5c259b-b81c-4af0-be5a-49d4b87b9704 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:50.904293 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf5c259b-b81c-4af0-be5a-49d4b87b9704 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:50.905011 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-bf5c259b-b81c-4af0-be5a-49d4b87b9704 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:51.128324 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a6824289-2c59-4174-82d3-6b82d251d9f6 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:51.156088 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a6824289-2c59-4174-82d3-6b82d251d9f6 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1561 microversion: 2.1 time: 0.337036 May 17 17:16:51.167800 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-bf5c259b-b81c-4af0-be5a-49d4b87b9704 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:51.169965 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 447/925] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:16:50 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1561 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:16:51.177516 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-bf5c259b-b81c-4af0-be5a-49d4b87b9704 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:51.179956 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-bf5c259b-b81c-4af0-be5a-49d4b87b9704 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:51.189424 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-bf5c259b-b81c-4af0-be5a-49d4b87b9704 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.295135 May 17 17:16:51.197169 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 479/926] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:50 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:52.213154 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-faf6c50c-64eb-4e5e-8f64-5ab999b17fda tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:52.213785 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-faf6c50c-64eb-4e5e-8f64-5ab999b17fda tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:52.220899 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-faf6c50c-64eb-4e5e-8f64-5ab999b17fda tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:52.221361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-faf6c50c-64eb-4e5e-8f64-5ab999b17fda tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:52.222142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-faf6c50c-64eb-4e5e-8f64-5ab999b17fda tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:52.222761 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-faf6c50c-64eb-4e5e-8f64-5ab999b17fda tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:52.351630 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-faf6c50c-64eb-4e5e-8f64-5ab999b17fda tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:52.361586 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-faf6c50c-64eb-4e5e-8f64-5ab999b17fda tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:52.363131 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-faf6c50c-64eb-4e5e-8f64-5ab999b17fda tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:52.364336 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-faf6c50c-64eb-4e5e-8f64-5ab999b17fda tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1732 microversion: 2.20 time: 0.154995 May 17 17:16:52.364894 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 448/927] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:52 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:53.382149 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f7428644-f190-4046-94f2-5a5bbe609221 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:53.382764 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f7428644-f190-4046-94f2-5a5bbe609221 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:53.389308 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f7428644-f190-4046-94f2-5a5bbe609221 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:53.389755 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f7428644-f190-4046-94f2-5a5bbe609221 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:53.390515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f7428644-f190-4046-94f2-5a5bbe609221 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:53.390951 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f7428644-f190-4046-94f2-5a5bbe609221 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:53.532439 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f7428644-f190-4046-94f2-5a5bbe609221 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:53.540224 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f7428644-f190-4046-94f2-5a5bbe609221 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:53.541715 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-f7428644-f190-4046-94f2-5a5bbe609221 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:16:53.543400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f7428644-f190-4046-94f2-5a5bbe609221 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1719 microversion: 2.20 time: 0.165135 May 17 17:16:53.544004 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 480/928] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:16:53 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:59.655338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-5f4cdbce-749d-4d75-bd61-2d849ef99d31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:59.656329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-5f4cdbce-749d-4d75-bd61-2d849ef99d31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:59.662629 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5f4cdbce-749d-4d75-bd61-2d849ef99d31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:59.663077 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5f4cdbce-749d-4d75-bd61-2d849ef99d31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:59.663863 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5f4cdbce-749d-4d75-bd61-2d849ef99d31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:59.664294 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5f4cdbce-749d-4d75-bd61-2d849ef99d31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:59.693368 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-5f4cdbce-749d-4d75-bd61-2d849ef99d31 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042720 May 17 17:16:59.694011 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 449/929] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:16:59 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:59.836988 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1fb265dd-4849-4ca2-92bd-29947c030fa4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:59.837520 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1fb265dd-4849-4ca2-92bd-29947c030fa4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:59.843920 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1fb265dd-4849-4ca2-92bd-29947c030fa4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:59.844366 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1fb265dd-4849-4ca2-92bd-29947c030fa4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:59.845151 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1fb265dd-4849-4ca2-92bd-29947c030fa4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:59.845582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1fb265dd-4849-4ca2-92bd-29947c030fa4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:59.873158 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1fb265dd-4849-4ca2-92bd-29947c030fa4 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments/6ca6a66c-eab6-4007-913e-e676adcd778e" status: 200 len: 194 microversion: 2.1 time: 0.040254 May 17 17:16:59.873722 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 481/930] 10.222.0.48 () {58 vars in 1412 bytes} [Tue May 17 17:16:59 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments/6ca6a66c-eab6-4007-913e-e676adcd778e => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:59.883199 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6d20cfee-c659-4c78-89e1-45862566d30f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:59.883725 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6d20cfee-c659-4c78-89e1-45862566d30f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:16:59.890383 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d20cfee-c659-4c78-89e1-45862566d30f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:59.890879 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d20cfee-c659-4c78-89e1-45862566d30f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:59.891672 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d20cfee-c659-4c78-89e1-45862566d30f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:16:59.892119 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d20cfee-c659-4c78-89e1-45862566d30f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:16:59.970326 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-6d20cfee-c659-4c78-89e1-45862566d30f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lazy-loading 'services' on Instance uuid 62871d39-e777-43e3-9d8e-949775d17a50 {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:17:00.039922 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6d20cfee-c659-4c78-89e1-45862566d30f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "DELETE /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments/6ca6a66c-eab6-4007-913e-e676adcd778e" status: 202 len: 0 microversion: 2.1 time: 0.160351 May 17 17:17:00.040580 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 450/931] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 17 17:16:59 2022] DELETE /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments/6ca6a66c-eab6-4007-913e-e676adcd778e => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:17:02.205877 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a4e630e1-6177-42f4-997c-155beab6aec6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:02.206457 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a4e630e1-6177-42f4-997c-155beab6aec6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:02.212500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a4e630e1-6177-42f4-997c-155beab6aec6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:02.212951 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a4e630e1-6177-42f4-997c-155beab6aec6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:02.213714 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a4e630e1-6177-42f4-997c-155beab6aec6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:02.214152 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a4e630e1-6177-42f4-997c-155beab6aec6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:02.243087 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a4e630e1-6177-42f4-997c-155beab6aec6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments/d365135a-0f87-4aa1-b8fa-750f126e28b7" status: 200 len: 194 microversion: 2.1 time: 0.041085 May 17 17:17:02.243698 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 482/932] 10.222.0.48 () {58 vars in 1412 bytes} [Tue May 17 17:17:02 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments/d365135a-0f87-4aa1-b8fa-750f126e28b7 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:02.255804 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2134a777-99a0-4eef-aa93-7df8a7e6e301 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:02.256442 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2134a777-99a0-4eef-aa93-7df8a7e6e301 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:02.262780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2134a777-99a0-4eef-aa93-7df8a7e6e301 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:02.263235 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2134a777-99a0-4eef-aa93-7df8a7e6e301 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:02.264034 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2134a777-99a0-4eef-aa93-7df8a7e6e301 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:02.264480 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2134a777-99a0-4eef-aa93-7df8a7e6e301 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:02.342510 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-2134a777-99a0-4eef-aa93-7df8a7e6e301 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lazy-loading 'services' on Instance uuid 62871d39-e777-43e3-9d8e-949775d17a50 {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:17:02.413669 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2134a777-99a0-4eef-aa93-7df8a7e6e301 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "DELETE /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments/d365135a-0f87-4aa1-b8fa-750f126e28b7" status: 202 len: 0 microversion: 2.1 time: 0.163062 May 17 17:17:02.414480 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 451/933] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 17 17:17:02 2022] DELETE /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments/d365135a-0f87-4aa1-b8fa-750f126e28b7 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:17:03.572120 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-14495ab2-5eef-4810-a24d-7141bbe8c32e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:03.573035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-14495ab2-5eef-4810-a24d-7141bbe8c32e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:03.579919 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-14495ab2-5eef-4810-a24d-7141bbe8c32e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:03.580360 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-14495ab2-5eef-4810-a24d-7141bbe8c32e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:03.581112 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-14495ab2-5eef-4810-a24d-7141bbe8c32e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:03.581567 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-14495ab2-5eef-4810-a24d-7141bbe8c32e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:03.608909 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-14495ab2-5eef-4810-a24d-7141bbe8c32e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040683 May 17 17:17:03.609455 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 483/934] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:17:03 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 17:17:03.712846 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e0d47ccb-fde2-442b-aec4-2eada17240c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:03.713910 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e0d47ccb-fde2-442b-aec4-2eada17240c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:03.721247 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e0d47ccb-fde2-442b-aec4-2eada17240c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:03.721704 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e0d47ccb-fde2-442b-aec4-2eada17240c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:03.722471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e0d47ccb-fde2-442b-aec4-2eada17240c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:03.722910 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e0d47ccb-fde2-442b-aec4-2eada17240c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:03.750009 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e0d47ccb-fde2-442b-aec4-2eada17240c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041497 May 17 17:17:03.750564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 452/935] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:17:03 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 17:17:03.806871 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-17ed586b-d538-4714-905d-f6ab14fe071e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:03.807364 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-17ed586b-d538-4714-905d-f6ab14fe071e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:03.813162 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-17ed586b-d538-4714-905d-f6ab14fe071e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:03.813626 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-17ed586b-d538-4714-905d-f6ab14fe071e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:03.814379 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-17ed586b-d538-4714-905d-f6ab14fe071e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:03.814811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-17ed586b-d538-4714-905d-f6ab14fe071e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:03.838798 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-17ed586b-d538-4714-905d-f6ab14fe071e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Going to try to terminate instance {{(pid=117090) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:17:03.912145 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-17ed586b-d538-4714-905d-f6ab14fe071e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "DELETE /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 204 len: 0 microversion: 2.1 time: 0.108767 May 17 17:17:03.912721 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 484/936] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:17:03 2022] DELETE /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:17:03.921400 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9ddc07b0-92ec-49f9-9137-ab0db076c4bc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:03.922015 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9ddc07b0-92ec-49f9-9137-ab0db076c4bc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:03.928378 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9ddc07b0-92ec-49f9-9137-ab0db076c4bc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:03.928862 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9ddc07b0-92ec-49f9-9137-ab0db076c4bc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:03.929751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9ddc07b0-92ec-49f9-9137-ab0db076c4bc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:03.930196 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9ddc07b0-92ec-49f9-9137-ab0db076c4bc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:04.057538 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9ddc07b0-92ec-49f9-9137-ab0db076c4bc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:04.065396 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9ddc07b0-92ec-49f9-9137-ab0db076c4bc tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1674 microversion: 2.1 time: 0.148233 May 17 17:17:04.065954 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 453/937] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:03 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:17:05.083946 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-47f88767-eb7f-4b64-8c61-9fb0a29a7fdb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:05.084641 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-47f88767-eb7f-4b64-8c61-9fb0a29a7fdb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:05.091099 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-47f88767-eb7f-4b64-8c61-9fb0a29a7fdb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:05.091668 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-47f88767-eb7f-4b64-8c61-9fb0a29a7fdb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:05.092445 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-47f88767-eb7f-4b64-8c61-9fb0a29a7fdb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:05.092876 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-47f88767-eb7f-4b64-8c61-9fb0a29a7fdb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:05.225369 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-47f88767-eb7f-4b64-8c61-9fb0a29a7fdb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:05.233153 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-47f88767-eb7f-4b64-8c61-9fb0a29a7fdb tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1674 microversion: 2.1 time: 0.153456 May 17 17:17:05.233709 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 485/938] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:05 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:06.250841 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3abf5871-5531-4820-96a8-873eb9be2b5b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:06.251441 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3abf5871-5531-4820-96a8-873eb9be2b5b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:06.257767 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3abf5871-5531-4820-96a8-873eb9be2b5b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:06.258214 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3abf5871-5531-4820-96a8-873eb9be2b5b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:06.258968 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3abf5871-5531-4820-96a8-873eb9be2b5b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:06.259400 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3abf5871-5531-4820-96a8-873eb9be2b5b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:06.385828 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3abf5871-5531-4820-96a8-873eb9be2b5b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:06.393397 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3abf5871-5531-4820-96a8-873eb9be2b5b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1674 microversion: 2.1 time: 0.147100 May 17 17:17:06.393959 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 454/939] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:06 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:07.411494 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-24e2b307-c0d3-425e-b3f4-b58cd8dd6a39 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:07.412079 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-24e2b307-c0d3-425e-b3f4-b58cd8dd6a39 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:07.418828 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-24e2b307-c0d3-425e-b3f4-b58cd8dd6a39 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:07.419345 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-24e2b307-c0d3-425e-b3f4-b58cd8dd6a39 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:07.420137 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-24e2b307-c0d3-425e-b3f4-b58cd8dd6a39 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:07.420569 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-24e2b307-c0d3-425e-b3f4-b58cd8dd6a39 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:07.544417 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-24e2b307-c0d3-425e-b3f4-b58cd8dd6a39 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:07.551657 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-24e2b307-c0d3-425e-b3f4-b58cd8dd6a39 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1674 microversion: 2.1 time: 0.144146 May 17 17:17:07.552219 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 486/940] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:07 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1674 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:08.569478 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f68f7866-65e7-4726-ae9c-04a19d9740c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:08.570091 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f68f7866-65e7-4726-ae9c-04a19d9740c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:08.577122 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f68f7866-65e7-4726-ae9c-04a19d9740c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:08.577574 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f68f7866-65e7-4726-ae9c-04a19d9740c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:08.578349 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f68f7866-65e7-4726-ae9c-04a19d9740c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:08.578782 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f68f7866-65e7-4726-ae9c-04a19d9740c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:08.708064 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f68f7866-65e7-4726-ae9c-04a19d9740c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:08.716188 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f68f7866-65e7-4726-ae9c-04a19d9740c2 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1674 microversion: 2.1 time: 0.150007 May 17 17:17:08.716809 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 455/941] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:08 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:09.257925 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-ad949dfb-1741-410c-b50e-9a89555e3ab5 req-bcf6984c-15dd-46a7-88b0-05a2b75ed55b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62871d39-e777-43e3-9d8e-949775d17a50", "name": "network-vif-deleted", "tag": "edbc0265-4f57-4250-800f-d5427b10d52d"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:17:09.269316 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-ad949dfb-1741-410c-b50e-9a89555e3ab5 req-bcf6984c-15dd-46a7-88b0-05a2b75ed55b service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:09.269767 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-ad949dfb-1741-410c-b50e-9a89555e3ab5 req-bcf6984c-15dd-46a7-88b0-05a2b75ed55b service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:09.284320 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-ad949dfb-1741-410c-b50e-9a89555e3ab5 req-bcf6984c-15dd-46a7-88b0-05a2b75ed55b service nova] Creating event network-vif-deleted:edbc0265-4f57-4250-800f-d5427b10d52d for instance 62871d39-e777-43e3-9d8e-949775d17a50 on hv-cinder-84214 May 17 17:17:09.289582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-ad949dfb-1741-410c-b50e-9a89555e3ab5 req-bcf6984c-15dd-46a7-88b0-05a2b75ed55b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035838 May 17 17:17:09.290181 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 487/942] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:09.733662 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-687edaf7-f449-4d79-8b4b-755de1b4043e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:09.734470 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-687edaf7-f449-4d79-8b4b-755de1b4043e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:09.741313 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-687edaf7-f449-4d79-8b4b-755de1b4043e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:09.742022 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-687edaf7-f449-4d79-8b4b-755de1b4043e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:09.742932 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-687edaf7-f449-4d79-8b4b-755de1b4043e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:09.743374 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-687edaf7-f449-4d79-8b4b-755de1b4043e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:09.775730 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-687edaf7-f449-4d79-8b4b-755de1b4043e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:09.776185 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-687edaf7-f449-4d79-8b4b-755de1b4043e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:09.776642 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-687edaf7-f449-4d79-8b4b-755de1b4043e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lazy-loading 'fault' on Instance uuid 62871d39-e777-43e3-9d8e-949775d17a50 {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:17:09.818822 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-687edaf7-f449-4d79-8b4b-755de1b4043e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cc0ddf89664a6f92c84ebb9e1ab3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f2aabc0cda49538fa0fd9d5db6bf51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:09.826873 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-687edaf7-f449-4d79-8b4b-755de1b4043e tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 200 len: 1327 microversion: 2.1 time: 0.097686 May 17 17:17:09.827449 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 456/943] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:09 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:10.845766 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-97dd5cd4-eeb2-44e4-b81a-0309ab3eaaa9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:10.846449 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-97dd5cd4-eeb2-44e4-b81a-0309ab3eaaa9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:10.852860 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-97dd5cd4-eeb2-44e4-b81a-0309ab3eaaa9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:10.853301 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-97dd5cd4-eeb2-44e4-b81a-0309ab3eaaa9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:10.854051 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-97dd5cd4-eeb2-44e4-b81a-0309ab3eaaa9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:10.854478 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-97dd5cd4-eeb2-44e4-b81a-0309ab3eaaa9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:10.868137 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-97dd5cd4-eeb2-44e4-b81a-0309ab3eaaa9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] HTTP exception thrown: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-97dd5cd4-eeb2-44e4-b81a-0309ab3eaaa9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Request method failure captured: May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 HTTP/1.1 May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9cJn-DS9kX286yRbLNd5tcZIMkJTirrs1xOw7kMf0sihHBZZGZB1P0YW9qBWvjugFwxy-6F6ljjXWDxpWuYBQJvAUTxpbbFqo5Av1ueTL7XNn_YrlQwfVI9HXyY67PMMHs8YNje0USF5Yn4dCctdGet80pl-r634Kv9wMdm7AgMRBU May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 87f2aabc0cda49538fa0fd9d5db6bf51 May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:17:10.869773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:17:10.871530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:10.871530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:10.871530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 87f2aabc0cda49538fa0fd9d5db6bf51 May 17 17:17:10.871530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:10.871530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-AttachVolumeTestJSON-95165178-project May 17 17:17:10.871530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:17:10.871530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:17:10.871530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 74cc0ddf89664a6f92c84ebb9e1ab3a2 May 17 17:17:10.871530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-AttachVolumeTestJSON-95165178-project May 17 17:17:10.871530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:17:10.871530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:10.871530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '62871d39-e777-43e3-9d8e-949775d17a50'} May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:10.872646 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:10.874199 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:10.875640 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-97dd5cd4-eeb2-44e4-b81a-0309ab3eaaa9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Returning 404 to user: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:10.875640 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-97dd5cd4-eeb2-44e4-b81a-0309ab3eaaa9 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 404 len: 111 microversion: 2.1 time: 0.029559 May 17 17:17:10.875640 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 488/944] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:10 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:17:10.884556 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-bcba3b0a-4d34-4076-b18d-f695021331e6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '.version_select at 0x7feb1ca34dc0>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:10.903569 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-bcba3b0a-4d34-4076-b18d-f695021331e6 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-116931882" status: 202 len: 0 microversion: 2.1 time: 0.022281 May 17 17:17:10.907631 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 457/945] 10.222.0.48 () {58 vars in 1217 bytes} [Tue May 17 17:17:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-116931882 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:17:13.804880 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-647b196a-63e8-4a6b-a69f-793df18d743b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:13.806065 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-647b196a-63e8-4a6b-a69f-793df18d743b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:13.813271 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-647b196a-63e8-4a6b-a69f-793df18d743b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:13.813831 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-647b196a-63e8-4a6b-a69f-793df18d743b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:13.814691 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-647b196a-63e8-4a6b-a69f-793df18d743b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:13.815271 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-647b196a-63e8-4a6b-a69f-793df18d743b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:13.835020 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-647b196a-63e8-4a6b-a69f-793df18d743b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] HTTP exception thrown: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-647b196a-63e8-4a6b-a69f-793df18d743b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Request method failure captured: May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: DELETE /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 HTTP/1.1 May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9cJn-DS9kX286yRbLNd5tcZIMkJTirrs1xOw7kMf0sihHBZZGZB1P0YW9qBWvjugFwxy-6F6ljjXWDxpWuYBQJvAUTxpbbFqo5Av1ueTL7XNn_YrlQwfVI9HXyY67PMMHs8YNje0USF5Yn4dCctdGet80pl-r634Kv9wMdm7AgMRBU May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 87f2aabc0cda49538fa0fd9d5db6bf51 May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:17:13.837035 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:17:13.838415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:13.838415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:13.838415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 87f2aabc0cda49538fa0fd9d5db6bf51 May 17 17:17:13.838415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:13.838415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-AttachVolumeTestJSON-95165178-project May 17 17:17:13.838415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:17:13.838415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:17:13.838415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 74cc0ddf89664a6f92c84ebb9e1ab3a2 May 17 17:17:13.838415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-AttachVolumeTestJSON-95165178-project May 17 17:17:13.838415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:17:13.838415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:13.838415 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '62871d39-e777-43e3-9d8e-949775d17a50'} May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:13.839146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:13.841090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:13.844348 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-647b196a-63e8-4a6b-a69f-793df18d743b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Returning 404 to user: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:13.845416 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-647b196a-63e8-4a6b-a69f-793df18d743b tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "DELETE /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 404 len: 111 microversion: 2.1 time: 0.044509 May 17 17:17:13.846501 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 489/946] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:17:13 2022] DELETE /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:17:13.854325 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ee0d2c54-57b1-4df6-966f-f5b9f1252cb1 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:13.856327 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ee0d2c54-57b1-4df6-966f-f5b9f1252cb1 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: 62871d39-e777-43e3-9d8e-949775d17a50] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:13.864773 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ee0d2c54-57b1-4df6-966f-f5b9f1252cb1 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:13.865557 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ee0d2c54-57b1-4df6-966f-f5b9f1252cb1 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:13.866593 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ee0d2c54-57b1-4df6-966f-f5b9f1252cb1 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:13.867044 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ee0d2c54-57b1-4df6-966f-f5b9f1252cb1 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:13.882184 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-ee0d2c54-57b1-4df6-966f-f5b9f1252cb1 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] HTTP exception thrown: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ee0d2c54-57b1-4df6-966f-f5b9f1252cb1 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Request method failure captured: May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 HTTP/1.1 May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9cJn-DS9kX286yRbLNd5tcZIMkJTirrs1xOw7kMf0sihHBZZGZB1P0YW9qBWvjugFwxy-6F6ljjXWDxpWuYBQJvAUTxpbbFqo5Av1ueTL7XNn_YrlQwfVI9HXyY67PMMHs8YNje0USF5Yn4dCctdGet80pl-r634Kv9wMdm7AgMRBU May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 87f2aabc0cda49538fa0fd9d5db6bf51 May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:17:13.883946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:17:13.885471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:13.885471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:13.885471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 87f2aabc0cda49538fa0fd9d5db6bf51 May 17 17:17:13.885471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:13.885471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-AttachVolumeTestJSON-95165178-project May 17 17:17:13.885471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:17:13.885471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:17:13.885471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 74cc0ddf89664a6f92c84ebb9e1ab3a2 May 17 17:17:13.885471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-AttachVolumeTestJSON-95165178-project May 17 17:17:13.885471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:17:13.885471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:13.885471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': '62871d39-e777-43e3-9d8e-949775d17a50'} May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:13.886338 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. May 17 17:17:13.888163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:13.889555 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ee0d2c54-57b1-4df6-966f-f5b9f1252cb1 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Returning 404 to user: Instance 62871d39-e777-43e3-9d8e-949775d17a50 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:13.889555 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ee0d2c54-57b1-4df6-966f-f5b9f1252cb1 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50" status: 404 len: 111 microversion: 2.1 time: 0.035028 May 17 17:17:13.889555 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 458/947] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:13 2022] GET /compute/v2.1/servers/62871d39-e777-43e3-9d8e-949775d17a50 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:17:15.063848 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ee450765-9b94-4bad-9de9-b2a0709d7827 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:15.065446 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ee450765-9b94-4bad-9de9-b2a0709d7827 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:15.076723 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ee450765-9b94-4bad-9de9-b2a0709d7827 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:15.076723 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ee450765-9b94-4bad-9de9-b2a0709d7827 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:15.077764 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ee450765-9b94-4bad-9de9-b2a0709d7827 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:15.078894 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ee450765-9b94-4bad-9de9-b2a0709d7827 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:15.106210 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-ee450765-9b94-4bad-9de9-b2a0709d7827 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] HTTP exception thrown: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ee450765-9b94-4bad-9de9-b2a0709d7827 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Request method failure captured: May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: DELETE /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 HTTP/1.1 May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9cJn-DS9kX286yRbLNd5tcZIMkJTirrs1xOw7kMf0sihHBZZGZB1P0YW9qBWvjugFwxy-6F6ljjXWDxpWuYBQJvAUTxpbbFqo5Av1ueTL7XNn_YrlQwfVI9HXyY67PMMHs8YNje0USF5Yn4dCctdGet80pl-r634Kv9wMdm7AgMRBU May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 87f2aabc0cda49538fa0fd9d5db6bf51 May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:17:15.109069 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:17:15.110400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:15.110400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:15.110400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 87f2aabc0cda49538fa0fd9d5db6bf51 May 17 17:17:15.110400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:15.110400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-AttachVolumeTestJSON-95165178-project May 17 17:17:15.110400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:17:15.110400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:17:15.110400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 74cc0ddf89664a6f92c84ebb9e1ab3a2 May 17 17:17:15.110400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-AttachVolumeTestJSON-95165178-project May 17 17:17:15.110400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:17:15.110400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:17:15.110400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': 'ee2bb8d5-d263-4ab1-8778-77fc4a30f388'} May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:15.111159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:17:15.113054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:15.114805 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ee450765-9b94-4bad-9de9-b2a0709d7827 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Returning 404 to user: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:15.114805 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ee450765-9b94-4bad-9de9-b2a0709d7827 tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 404 len: 111 microversion: 2.1 time: 0.051452 May 17 17:17:15.114805 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 490/948] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:17:15 2022] DELETE /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:17:15.120523 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-308c0a4c-deb8-4153-b9b6-32982ba0ec5f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:15.121282 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-308c0a4c-deb8-4153-b9b6-32982ba0ec5f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] [instance: ee2bb8d5-d263-4ab1-8778-77fc4a30f388] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:15.128956 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-308c0a4c-deb8-4153-b9b6-32982ba0ec5f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:15.129512 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-308c0a4c-deb8-4153-b9b6-32982ba0ec5f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:15.130357 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-308c0a4c-deb8-4153-b9b6-32982ba0ec5f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:15.130865 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-308c0a4c-deb8-4153-b9b6-32982ba0ec5f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:15.147624 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-308c0a4c-deb8-4153-b9b6-32982ba0ec5f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] HTTP exception thrown: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-308c0a4c-deb8-4153-b9b6-32982ba0ec5f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Request method failure captured: May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 HTTP/1.1 May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9cJn-DS9kX286yRbLNd5tcZIMkJTirrs1xOw7kMf0sihHBZZGZB1P0YW9qBWvjugFwxy-6F6ljjXWDxpWuYBQJvAUTxpbbFqo5Av1ueTL7XNn_YrlQwfVI9HXyY67PMMHs8YNje0USF5Yn4dCctdGet80pl-r634Kv9wMdm7AgMRBU May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 87f2aabc0cda49538fa0fd9d5db6bf51 May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:17:15.149187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:17:15.150890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87f2aabc0cda49538fa0fd9d5db6bf51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:15.150890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:15.150890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 87f2aabc0cda49538fa0fd9d5db6bf51 May 17 17:17:15.150890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-AttachVolumeTestJSON-95165178 May 17 17:17:15.150890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-AttachVolumeTestJSON-95165178-project May 17 17:17:15.150890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:17:15.150890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:17:15.150890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 74cc0ddf89664a6f92c84ebb9e1ab3a2 May 17 17:17:15.150890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-AttachVolumeTestJSON-95165178-project May 17 17:17:15.150890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:17:15.150890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:17:15.150890 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': 'ee2bb8d5-d263-4ab1-8778-77fc4a30f388'} May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:15.152611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. May 17 17:17:15.154964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:15.156428 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-308c0a4c-deb8-4153-b9b6-32982ba0ec5f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] Returning 404 to user: Instance ee2bb8d5-d263-4ab1-8778-77fc4a30f388 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:15.156428 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-308c0a4c-deb8-4153-b9b6-32982ba0ec5f tempest-AttachVolumeTestJSON-95165178 tempest-AttachVolumeTestJSON-95165178-project] 10.222.0.48 "GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388" status: 404 len: 111 microversion: 2.1 time: 0.035022 May 17 17:17:15.156428 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 459/949] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:15 2022] GET /compute/v2.1/servers/ee2bb8d5-d263-4ab1-8778-77fc4a30f388 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 17:17:21.273968 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-501caae8-869e-40fa-8c7c-edde7e7f179a tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] Action: 'create', calling method: .version_select at 0x7feb12f87d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1989393218", "metadata": {"Type": "work"}}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:17:21.825188 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-501caae8-869e-40fa-8c7c-edde7e7f179a tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.704633 May 17 17:17:21.837243 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-36864dbc-0c89-468c-8579-1365e786507d tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] Calling method '.version_select at 0x7feb181f1c10>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:21.838178 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 491/950] 10.222.0.48 () {60 vars in 1155 bytes} [Tue May 17 17:17:21 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 718 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 17 17:17:21.928555 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-36864dbc-0c89-468c-8579-1365e786507d tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4bd6c0cf-16fd-41ba-9b69-f76db996c198" status: 200 len: 353 microversion: 2.1 time: 0.095272 May 17 17:17:21.931225 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 460/951] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:17:21 2022] GET /compute/v2.1/os-volumes/4bd6c0cf-16fd-41ba-9b69-f76db996c198 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:22.045837 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f62b7320-0e66-47da-9c84-ba61118ce49f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:22.046489 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f62b7320-0e66-47da-9c84-ba61118ce49f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:22.059382 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f62b7320-0e66-47da-9c84-ba61118ce49f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:22.059876 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f62b7320-0e66-47da-9c84-ba61118ce49f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:22.060664 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f62b7320-0e66-47da-9c84-ba61118ce49f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:22.061111 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f62b7320-0e66-47da-9c84-ba61118ce49f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:22.142663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f62b7320-0e66-47da-9c84-ba61118ce49f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Going to try to terminate instance {{(pid=117090) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:17:22.282074 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f62b7320-0e66-47da-9c84-ba61118ce49f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "DELETE /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 204 len: 0 microversion: 2.1 time: 0.239712 May 17 17:17:22.282858 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 492/952] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:17:22 2022] DELETE /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:17:22.293326 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3d08d5f8-2d98-422b-ac03-feaf22cc2af0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:22.294241 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3d08d5f8-2d98-422b-ac03-feaf22cc2af0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:22.304823 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3d08d5f8-2d98-422b-ac03-feaf22cc2af0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:22.305396 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3d08d5f8-2d98-422b-ac03-feaf22cc2af0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:22.306509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3d08d5f8-2d98-422b-ac03-feaf22cc2af0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:22.307044 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3d08d5f8-2d98-422b-ac03-feaf22cc2af0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:22.469221 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3d08d5f8-2d98-422b-ac03-feaf22cc2af0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:22.477291 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3d08d5f8-2d98-422b-ac03-feaf22cc2af0 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1576 microversion: 2.1 time: 0.189711 May 17 17:17:22.478140 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 461/953] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:22 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:22.947266 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-6d0e9efe-7455-4c54-8fba-c3bf45787fde tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] Calling method '.version_select at 0x7feb12f04a60>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:23.039726 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-6d0e9efe-7455-4c54-8fba-c3bf45787fde tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4bd6c0cf-16fd-41ba-9b69-f76db996c198" status: 200 len: 354 microversion: 2.1 time: 0.097574 May 17 17:17:23.040565 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 493/954] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:17:22 2022] GET /compute/v2.1/os-volumes/4bd6c0cf-16fd-41ba-9b69-f76db996c198 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:23.051866 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ddd39b79-128e-4bf9-96b0-192eac734944 tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] Calling method '.version_select at 0x7feb13777dc0>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:23.128739 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ddd39b79-128e-4bf9-96b0-192eac734944 tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4bd6c0cf-16fd-41ba-9b69-f76db996c198" status: 200 len: 354 microversion: 2.1 time: 0.080785 May 17 17:17:23.130223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 462/955] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:17:23 2022] GET /compute/v2.1/os-volumes/4bd6c0cf-16fd-41ba-9b69-f76db996c198 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:23.148234 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a93fff69-ede7-47fb-9491-c9c2e0064296 tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] Calling method '.version_select at 0x7feb18056dc0>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:23.236863 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a93fff69-ede7-47fb-9491-c9c2e0064296 tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/4bd6c0cf-16fd-41ba-9b69-f76db996c198" status: 202 len: 0 microversion: 2.1 time: 0.094297 May 17 17:17:23.239491 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 494/956] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 17 17:17:23 2022] DELETE /compute/v2.1/os-volumes/4bd6c0cf-16fd-41ba-9b69-f76db996c198 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:17:23.247979 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-604c8320-ad59-428a-8922-4cd041a58247 tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] Calling method '.version_select at 0x7feb13752d30>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:23.309035 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-604c8320-ad59-428a-8922-4cd041a58247 tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4bd6c0cf-16fd-41ba-9b69-f76db996c198" status: 200 len: 353 microversion: 2.1 time: 0.064703 May 17 17:17:23.311033 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 463/957] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:17:23 2022] GET /compute/v2.1/os-volumes/4bd6c0cf-16fd-41ba-9b69-f76db996c198 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:23.498250 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e4946465-4b51-42ee-8783-3b922d7c8c84 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:23.499709 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-e4946465-4b51-42ee-8783-3b922d7c8c84 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:23.517558 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e4946465-4b51-42ee-8783-3b922d7c8c84 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:23.518414 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e4946465-4b51-42ee-8783-3b922d7c8c84 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:23.519457 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e4946465-4b51-42ee-8783-3b922d7c8c84 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:23.520175 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-e4946465-4b51-42ee-8783-3b922d7c8c84 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:23.733004 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-e4946465-4b51-42ee-8783-3b922d7c8c84 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:23.740867 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e4946465-4b51-42ee-8783-3b922d7c8c84 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1576 microversion: 2.1 time: 0.249160 May 17 17:17:23.744607 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 495/958] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:23 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:24.332001 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-07c6186e-adfa-4a65-baa8-c7f1d5c8bf73 tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] Calling method '.version_select at 0x7feb1ca50ee0>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:24.377058 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-07c6186e-adfa-4a65-baa8-c7f1d5c8bf73 tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] HTTP exception thrown: Volume 4bd6c0cf-16fd-41ba-9b69-f76db996c198 could not be found. May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-07c6186e-adfa-4a65-baa8-c7f1d5c8bf73 tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] Request method failure captured: May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/os-volumes/4bd6c0cf-16fd-41ba-9b69-f76db996c198 HTTP/1.1 May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9ihTJT3arOrGfwy9QOq9VUTp-2bRyG0TaOhN7JkLNBwwloTEmW61qIV53zytPAnJtsJbU8ulEv6z50o7JqQ-dwePed3V4lVOs-G7hxKe3nzQs6JQOc5Vm7uqiyKTlw3jPVNcKejkkuJPQPmcuxEtXx17ahf00-lpxaAVjDu276N9pM May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 4fb89f649b6a4e70885150deda6f4409 May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-VolumesGetTestJSON-1744800275 May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:17:24.379414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:17:24.381432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4fb89f649b6a4e70885150deda6f4409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4fb89f649b6a4e70885150deda6f4409"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4fb89f649b6a4e70885150deda6f4409"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4fb89f649b6a4e70885150deda6f4409"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:24.381432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-VolumesGetTestJSON-1744800275 May 17 17:17:24.381432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 4fb89f649b6a4e70885150deda6f4409 May 17 17:17:24.381432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-VolumesGetTestJSON-1744800275 May 17 17:17:24.381432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-VolumesGetTestJSON-1744800275-project May 17 17:17:24.381432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:17:24.381432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:17:24.381432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: dc062aadbfa54ca981f518400571fd23 May 17 17:17:24.381432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-VolumesGetTestJSON-1744800275-project May 17 17:17:24.381432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: May 17 17:17:24.381432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Volume 4bd6c0cf-16fd-41ba-9b69-f76db996c198 could not be found. May 17 17:17:24.381432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': '4bd6c0cf-16fd-41ba-9b69-f76db996c198'} May 17 17:17:24.381432 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4bd6c0cf-16fd-41ba-9b69-f76db996c198 could not be found. (HTTP 404) (Request-ID: req-d53dda38-89b6-4076-a8b1-57f0cce17c02) May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:24.383025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:17:24.385200 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4bd6c0cf-16fd-41ba-9b69-f76db996c198 could not be found. May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 17:17:24.387355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:24.392142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4bd6c0cf-16fd-41ba-9b69-f76db996c198 could not be found. May 17 17:17:24.392142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:24.392142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:24.392142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:24.392142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:24.392142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:24.392142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:24.392142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:24.392142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:24.392142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4bd6c0cf-16fd-41ba-9b69-f76db996c198 could not be found. May 17 17:17:24.392142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:24.392142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-07c6186e-adfa-4a65-baa8-c7f1d5c8bf73 tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] Returning 404 to user: Volume 4bd6c0cf-16fd-41ba-9b69-f76db996c198 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:24.392142 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-07c6186e-adfa-4a65-baa8-c7f1d5c8bf73 tempest-VolumesGetTestJSON-1744800275 tempest-VolumesGetTestJSON-1744800275-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4bd6c0cf-16fd-41ba-9b69-f76db996c198" status: 404 len: 109 microversion: 2.1 time: 0.064495 May 17 17:17:24.396252 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 464/959] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 17 17:17:24 2022] GET /compute/v2.1/os-volumes/4bd6c0cf-16fd-41ba-9b69-f76db996c198 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:17:24.762977 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-228cd0d2-361f-4235-ad13-19bbd099c288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:24.763785 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-228cd0d2-361f-4235-ad13-19bbd099c288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:24.772469 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-228cd0d2-361f-4235-ad13-19bbd099c288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:24.772844 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-228cd0d2-361f-4235-ad13-19bbd099c288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:24.774421 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-228cd0d2-361f-4235-ad13-19bbd099c288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:24.774874 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-228cd0d2-361f-4235-ad13-19bbd099c288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:25.060526 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-228cd0d2-361f-4235-ad13-19bbd099c288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:25.073715 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-228cd0d2-361f-4235-ad13-19bbd099c288 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1576 microversion: 2.1 time: 0.315789 May 17 17:17:25.074456 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 496/960] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:24 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1576 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:26.092417 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-c1c7c25f-b871-4ae5-9b73-525da2b67d72 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:26.093190 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-c1c7c25f-b871-4ae5-9b73-525da2b67d72 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:26.102293 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c1c7c25f-b871-4ae5-9b73-525da2b67d72 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:26.104170 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c1c7c25f-b871-4ae5-9b73-525da2b67d72 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:26.105460 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c1c7c25f-b871-4ae5-9b73-525da2b67d72 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:26.106832 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c1c7c25f-b871-4ae5-9b73-525da2b67d72 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:26.175225 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-af81c627-7a9e-4e7f-8f27-657127f58d97 req-d6e1c5a1-590a-4852-a83c-1b3158eaac6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50898191-2e63-45d2-85bb-e47d9fe6d844", "name": "network-vif-deleted", "tag": "efa762a5-a4d8-4cff-ba5a-528a674014b1"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:17:26.215143 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-af81c627-7a9e-4e7f-8f27-657127f58d97 req-d6e1c5a1-590a-4852-a83c-1b3158eaac6b service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:26.219002 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-af81c627-7a9e-4e7f-8f27-657127f58d97 req-d6e1c5a1-590a-4852-a83c-1b3158eaac6b service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:26.268782 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-af81c627-7a9e-4e7f-8f27-657127f58d97 req-d6e1c5a1-590a-4852-a83c-1b3158eaac6b service nova] Creating event network-vif-deleted:efa762a5-a4d8-4cff-ba5a-528a674014b1 for instance 50898191-2e63-45d2-85bb-e47d9fe6d844 on hv-cinder-84214 May 17 17:17:26.295727 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-af81c627-7a9e-4e7f-8f27-657127f58d97 req-d6e1c5a1-590a-4852-a83c-1b3158eaac6b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135908 May 17 17:17:26.298752 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 497/961] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:17:26.302853 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-c1c7c25f-b871-4ae5-9b73-525da2b67d72 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:26.317261 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-c1c7c25f-b871-4ae5-9b73-525da2b67d72 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 200 len: 1509 microversion: 2.1 time: 0.227453 May 17 17:17:26.319656 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 465/962] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:26 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:27.335452 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-60061117-3744-4fd8-892e-17840e823f2a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:27.336329 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-60061117-3744-4fd8-892e-17840e823f2a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:27.349387 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-60061117-3744-4fd8-892e-17840e823f2a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:27.349843 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-60061117-3744-4fd8-892e-17840e823f2a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:27.367927 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-60061117-3744-4fd8-892e-17840e823f2a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:27.368510 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-60061117-3744-4fd8-892e-17840e823f2a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:27.417958 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-60061117-3744-4fd8-892e-17840e823f2a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] HTTP exception thrown: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-60061117-3744-4fd8-892e-17840e823f2a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Request method failure captured: May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 HTTP/1.1 May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9f5thZO438wSlY1p3r4IvV9x5LqPi5FFcFh7EEqTOFHIztCDNXqF8L6W_gcRmRZCfqpaTXP2--sj5apxSlSfDr-kBabsSX_-5vIsxSpQ7-pyPE_qxddDUwcgHX23FoQZ3ND43OIxwVT-6vFsSo9Y4r_b3I84nC70r_nGMpXaFOvvfE May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: b1528992e3c74c08b5c4192466f23852 May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-TestVolumeBootPattern-2122050549 May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:17:27.419923 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:17:27.421634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b1528992e3c74c08b5c4192466f23852"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:27.421634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-TestVolumeBootPattern-2122050549 May 17 17:17:27.421634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: b1528992e3c74c08b5c4192466f23852 May 17 17:17:27.421634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122050549 May 17 17:17:27.421634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-TestVolumeBootPattern-2122050549-project May 17 17:17:27.421634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:17:27.421634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:17:27.421634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 38bdb5f8e08e49358f9f27e4f1ce167b May 17 17:17:27.421634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-TestVolumeBootPattern-2122050549-project May 17 17:17:27.421634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:17:27.421634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:17:27.421634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '50898191-2e63-45d2-85bb-e47d9fe6d844'} May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:27.422484 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:17:27.423879 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:27.424982 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-60061117-3744-4fd8-892e-17840e823f2a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Returning 404 to user: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:27.424982 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-60061117-3744-4fd8-892e-17840e823f2a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 404 len: 111 microversion: 2.1 time: 0.090694 May 17 17:17:27.436339 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 498/963] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:27 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:17:27.605592 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1157893511", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-402373830", "security_groups": [{"name": "tempest-secgroup-smoke-927017117"}], "block_device_mapping_v2": [{"uuid": "346e8d86-df39-416a-9bf6-e28630331815", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f954c18a-8821-47ca-8b80-a2fbc154db5e"}]}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:17:27.820643 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] validate_networks() for [('f954c18a-8821-47ca-8b80-a2fbc154db5e', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:17:28.486961 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:17:28.487811 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:17:28.488836 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:17:28.489484 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:17:28.490473 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:17:28.511019 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:28.513029 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:28.516072 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:28.517317 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:28.564725 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Getting quotas for project b1528992e3c74c08b5c4192466f23852. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:17:28.576069 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Getting quotas for user 38bdb5f8e08e49358f9f27e4f1ce167b and project b1528992e3c74c08b5c4192466f23852. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:17:28.773191 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:17:28.776320 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='346e8d86-df39-416a-9bf6-e28630331815',volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:17:29.020946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7926f22b-0ec3-4ba6-bdd2-625f00250983 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.417038 May 17 17:17:29.022376 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 466/964] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:17:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:17:29.032781 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-551d0c47-4e1f-4678-a401-896b66653400 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:29.033392 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-551d0c47-4e1f-4678-a401-896b66653400 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:29.111288 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-551d0c47-4e1f-4678-a401-896b66653400 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:29.121629 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-551d0c47-4e1f-4678-a401-896b66653400 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1094 microversion: 2.1 time: 0.092481 May 17 17:17:29.123029 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 499/965] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:29 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:29.130983 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-378c1095-4151-4a1c-8776-07b39b58fed2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:29.131869 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-378c1095-4151-4a1c-8776-07b39b58fed2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:29.140427 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-378c1095-4151-4a1c-8776-07b39b58fed2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:29.146141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-378c1095-4151-4a1c-8776-07b39b58fed2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:29.147209 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-378c1095-4151-4a1c-8776-07b39b58fed2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:29.147772 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-378c1095-4151-4a1c-8776-07b39b58fed2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:29.183575 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-378c1095-4151-4a1c-8776-07b39b58fed2 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/ips" status: 200 len: 149 microversion: 2.1 time: 0.056283 May 17 17:17:29.190021 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 467/966] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 17 17:17:29 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/ips => generated 149 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:30.139865 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-86066ed6-05c4-434b-a2d1-6749c1f44dc6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:30.141106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-86066ed6-05c4-434b-a2d1-6749c1f44dc6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:30.156872 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-86066ed6-05c4-434b-a2d1-6749c1f44dc6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:30.160399 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-86066ed6-05c4-434b-a2d1-6749c1f44dc6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:30.161205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-86066ed6-05c4-434b-a2d1-6749c1f44dc6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:30.163156 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-86066ed6-05c4-434b-a2d1-6749c1f44dc6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:30.257353 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-86066ed6-05c4-434b-a2d1-6749c1f44dc6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:30.278934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-86066ed6-05c4-434b-a2d1-6749c1f44dc6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1192 microversion: 2.1 time: 0.143011 May 17 17:17:30.282106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 500/967] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:30 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1192 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:30.726793 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-bc22b05a-5ea0-48b6-9779-11d3c9626e53 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d541edc0-07cf-4dd6-85ed-af25a6916c38"}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:17:30.728160 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-bc22b05a-5ea0-48b6-9779-11d3c9626e53 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:30.751365 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bc22b05a-5ea0-48b6-9779-11d3c9626e53 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:30.752188 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bc22b05a-5ea0-48b6-9779-11d3c9626e53 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:30.753166 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bc22b05a-5ea0-48b6-9779-11d3c9626e53 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:30.753798 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-bc22b05a-5ea0-48b6-9779-11d3c9626e53 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:31.259715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-bc22b05a-5ea0-48b6-9779-11d3c9626e53 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "POST /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535670 May 17 17:17:31.267553 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 468/968] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 17 17:17:30 2022] POST /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments => generated 194 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:31.308846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b58bde45-abce-47fc-8284-d180f299b1c4 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:31.310802 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b58bde45-abce-47fc-8284-d180f299b1c4 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:31.340064 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b58bde45-abce-47fc-8284-d180f299b1c4 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:31.340726 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b58bde45-abce-47fc-8284-d180f299b1c4 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:31.341543 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b58bde45-abce-47fc-8284-d180f299b1c4 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:31.341984 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b58bde45-abce-47fc-8284-d180f299b1c4 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:31.597786 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b58bde45-abce-47fc-8284-d180f299b1c4 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:31.606105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b58bde45-abce-47fc-8284-d180f299b1c4 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1265 microversion: 2.1 time: 0.311751 May 17 17:17:31.606692 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 501/969] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:31 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:17:32.496129 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-9ec0bbf6-3dcf-4e6e-a6fe-0012fc8fe071 req-4190666d-a35c-4c0e-82a5-baad81c7d024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82812c49-fa86-43cc-ab6f-2df6bf74dfd8", "tag": "69a028cd-6a7e-49ed-93d6-e5229bb69b2c"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:17:32.517983 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-9ec0bbf6-3dcf-4e6e-a6fe-0012fc8fe071 req-4190666d-a35c-4c0e-82a5-baad81c7d024 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:32.523894 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-9ec0bbf6-3dcf-4e6e-a6fe-0012fc8fe071 req-4190666d-a35c-4c0e-82a5-baad81c7d024 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:32.546320 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-9ec0bbf6-3dcf-4e6e-a6fe-0012fc8fe071 req-4190666d-a35c-4c0e-82a5-baad81c7d024 service nova] Creating event network-changed:69a028cd-6a7e-49ed-93d6-e5229bb69b2c for instance 82812c49-fa86-43cc-ab6f-2df6bf74dfd8 on hv-cinder-84214 May 17 17:17:32.552604 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-9ec0bbf6-3dcf-4e6e-a6fe-0012fc8fe071 req-4190666d-a35c-4c0e-82a5-baad81c7d024 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061246 May 17 17:17:32.554353 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 469/970] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:32.625010 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-197ea480-9105-4ba1-abd5-e851b065797c tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:32.625633 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-197ea480-9105-4ba1-abd5-e851b065797c tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:32.639351 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-197ea480-9105-4ba1-abd5-e851b065797c tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:32.640083 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-197ea480-9105-4ba1-abd5-e851b065797c tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:32.641055 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-197ea480-9105-4ba1-abd5-e851b065797c tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:32.641657 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-197ea480-9105-4ba1-abd5-e851b065797c tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:32.902304 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-197ea480-9105-4ba1-abd5-e851b065797c tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:32.912541 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-197ea480-9105-4ba1-abd5-e851b065797c tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1265 microversion: 2.1 time: 0.290575 May 17 17:17:32.913133 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 502/971] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:32 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:33.931799 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-95c46b45-4e4a-46c4-969c-8b6cc9bd8749 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:33.933706 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-95c46b45-4e4a-46c4-969c-8b6cc9bd8749 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:33.940190 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-95c46b45-4e4a-46c4-969c-8b6cc9bd8749 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:33.942359 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-95c46b45-4e4a-46c4-969c-8b6cc9bd8749 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:33.943357 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-95c46b45-4e4a-46c4-969c-8b6cc9bd8749 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:33.945646 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-95c46b45-4e4a-46c4-969c-8b6cc9bd8749 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:34.146757 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-95c46b45-4e4a-46c4-969c-8b6cc9bd8749 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:34.155269 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-95c46b45-4e4a-46c4-969c-8b6cc9bd8749 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1265 microversion: 2.1 time: 0.228698 May 17 17:17:34.164961 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 470/972] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:33 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:35.034166 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-27a40b43-6b53-4839-a64c-e9952e4493a0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:35.035739 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-27a40b43-6b53-4839-a64c-e9952e4493a0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:35.044478 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-27a40b43-6b53-4839-a64c-e9952e4493a0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:35.045162 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-27a40b43-6b53-4839-a64c-e9952e4493a0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:35.046116 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-27a40b43-6b53-4839-a64c-e9952e4493a0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:35.046748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-27a40b43-6b53-4839-a64c-e9952e4493a0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:35.084760 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-27a40b43-6b53-4839-a64c-e9952e4493a0 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054710 May 17 17:17:35.085755 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 503/973] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 17 17:17:35 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:17:35.175429 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-eeac3c36-9fbb-450a-807e-77251e9579ad tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:35.176271 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-eeac3c36-9fbb-450a-807e-77251e9579ad tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:35.190390 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9909b6d8-24aa-4c7e-9478-38ff5ff5ef6f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Action: 'create', calling method: .version_select at 0x7feb12ee28b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2002295584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMXtrcVIk36cMvZPiipKozO5DDyk/x5pOsRuA4oB8P0XM9OHrnITUGzoCyjhnfsKvvgpFMqaGdbmnHj9QMh3ov3apCkewAr6U4HgY5Yrlkojs/jbQhZ67+SUj6uPJS7Tw=="}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:17:35.195509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eeac3c36-9fbb-450a-807e-77251e9579ad tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:35.197118 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eeac3c36-9fbb-450a-807e-77251e9579ad tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:35.198699 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eeac3c36-9fbb-450a-807e-77251e9579ad tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:35.201747 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-eeac3c36-9fbb-450a-807e-77251e9579ad tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:35.205119 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-9909b6d8-24aa-4c7e-9478-38ff5ff5ef6f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Getting quotas for project 21c32c98238c44e7a3581a668e1a5ea3. Resources: {'key_pairs'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:17:35.209469 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.quota [None req-9909b6d8-24aa-4c7e-9478-38ff5ff5ef6f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Getting quotas for user b62f5ec1700d4a86aab654c9f2eb0201 and project 21c32c98238c44e7a3581a668e1a5ea3. Resources: {'key_pairs'} {{(pid=117090) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:17:35.240845 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9909b6d8-24aa-4c7e-9478-38ff5ff5ef6f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054167 May 17 17:17:35.241775 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 504/974] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 17 17:17:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:17:35.247194 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-63f2d977-bfab-447a-a2b8-62f85ce3ba1d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:35.247731 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-63f2d977-bfab-447a-a2b8-62f85ce3ba1d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:35.254190 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-63f2d977-bfab-447a-a2b8-62f85ce3ba1d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:35.254893 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-63f2d977-bfab-447a-a2b8-62f85ce3ba1d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:35.255994 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-63f2d977-bfab-447a-a2b8-62f85ce3ba1d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:35.256909 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-63f2d977-bfab-447a-a2b8-62f85ce3ba1d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:35.300323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-63f2d977-bfab-447a-a2b8-62f85ce3ba1d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Going to try to terminate instance {{(pid=117090) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:17:35.456631 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-63f2d977-bfab-447a-a2b8-62f85ce3ba1d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 204 len: 0 microversion: 2.20 time: 0.211390 May 17 17:17:35.458120 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 505/975] 10.222.0.48 () {60 vars in 1279 bytes} [Tue May 17 17:17:35 2022] DELETE /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 17:17:35.485098 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b9dd76c9-f093-4c5d-bc0a-8656efbc9219 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:35.485905 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b9dd76c9-f093-4c5d-bc0a-8656efbc9219 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:35.492022 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b9dd76c9-f093-4c5d-bc0a-8656efbc9219 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:35.492556 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b9dd76c9-f093-4c5d-bc0a-8656efbc9219 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:35.493335 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b9dd76c9-f093-4c5d-bc0a-8656efbc9219 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:35.493769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b9dd76c9-f093-4c5d-bc0a-8656efbc9219 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:35.524745 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-eeac3c36-9fbb-450a-807e-77251e9579ad tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:35.533404 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-eeac3c36-9fbb-450a-807e-77251e9579ad tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1265 microversion: 2.1 time: 0.364221 May 17 17:17:35.533987 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 471/976] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:35 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1265 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:35.541492 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1921440370", "imageRef": "97031944-9129-4fb7-a0db-01c0e3ed3544", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2002295584", "networks": [{"uuid": "dc3d4c09-8a68-4f06-a953-436db768a877"}]}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:17:35.595895 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] validate_networks() for [('dc3d4c09-8a68-4f06-a953-436db768a877', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:17:35.660769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b9dd76c9-f093-4c5d-bc0a-8656efbc9219 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:35.669702 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b9dd76c9-f093-4c5d-bc0a-8656efbc9219 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:35.672150 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b9dd76c9-f093-4c5d-bc0a-8656efbc9219 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:35.673686 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b9dd76c9-f093-4c5d-bc0a-8656efbc9219 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.200421 May 17 17:17:35.674716 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 506/977] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:17:35 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:17:36.010375 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:17:36.011350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:17:36.011863 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:17:36.012322 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:17:36.012780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:17:36.021365 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:36.021814 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:36.022622 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:36.023055 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:36.040314 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Getting quotas for project 21c32c98238c44e7a3581a668e1a5ea3. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:17:36.044282 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Getting quotas for user b62f5ec1700d4a86aab654c9f2eb0201 and project 21c32c98238c44e7a3581a668e1a5ea3. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:17:36.054903 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:17:36.057148 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97031944-9129-4fb7-a0db-01c0e3ed3544',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:17:36.106040 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ea15f320-a5d0-4427-8dbc-2f760a80d22c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570940 May 17 17:17:36.106668 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 472/978] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:17:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:17:36.116768 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-e923e6e2-ecd2-40c9-9c23-469a6d848d91 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:36.117551 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-e923e6e2-ecd2-40c9-9c23-469a6d848d91 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:36.170342 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-e923e6e2-ecd2-40c9-9c23-469a6d848d91 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:36.176878 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-e923e6e2-ecd2-40c9-9c23-469a6d848d91 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1259 microversion: 2.1 time: 0.064114 May 17 17:17:36.177465 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 507/979] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:36 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1259 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:17:36.550597 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ccada684-1499-4bd9-be07-b9b40737b33f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:36.551194 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ccada684-1499-4bd9-be07-b9b40737b33f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:36.557977 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ccada684-1499-4bd9-be07-b9b40737b33f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:36.558484 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ccada684-1499-4bd9-be07-b9b40737b33f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:36.559339 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ccada684-1499-4bd9-be07-b9b40737b33f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:36.559895 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ccada684-1499-4bd9-be07-b9b40737b33f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:36.691032 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ccada684-1499-4bd9-be07-b9b40737b33f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:36.693939 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b6980eaf-177e-47d3-bc23-b1934b3cc020 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:36.695562 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b6980eaf-177e-47d3-bc23-b1934b3cc020 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:36.700057 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ccada684-1499-4bd9-be07-b9b40737b33f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1265 microversion: 2.1 time: 0.153635 May 17 17:17:36.700847 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 473/980] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:36 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:36.711255 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b6980eaf-177e-47d3-bc23-b1934b3cc020 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:36.711732 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b6980eaf-177e-47d3-bc23-b1934b3cc020 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:36.712516 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b6980eaf-177e-47d3-bc23-b1934b3cc020 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:36.712946 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b6980eaf-177e-47d3-bc23-b1934b3cc020 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:36.848823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b6980eaf-177e-47d3-bc23-b1934b3cc020 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:36.856859 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b6980eaf-177e-47d3-bc23-b1934b3cc020 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:36.858348 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b6980eaf-177e-47d3-bc23-b1934b3cc020 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:36.859487 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b6980eaf-177e-47d3-bc23-b1934b3cc020 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1725 microversion: 2.20 time: 0.169862 May 17 17:17:36.860067 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 508/981] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:17:36 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:17:37.194090 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-418db80b-a22f-4cfb-ae8d-1141e2162d6f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:37.194938 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-418db80b-a22f-4cfb-ae8d-1141e2162d6f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:37.203195 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-418db80b-a22f-4cfb-ae8d-1141e2162d6f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:37.203815 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-418db80b-a22f-4cfb-ae8d-1141e2162d6f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:37.204662 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-418db80b-a22f-4cfb-ae8d-1141e2162d6f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:37.205162 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-418db80b-a22f-4cfb-ae8d-1141e2162d6f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:37.273477 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-418db80b-a22f-4cfb-ae8d-1141e2162d6f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:37.281067 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-418db80b-a22f-4cfb-ae8d-1141e2162d6f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1319 microversion: 2.1 time: 0.091382 May 17 17:17:37.281623 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 474/982] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:37 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1319 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:37.716269 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-787776ae-0eb0-4712-8951-1d79dcdfd5f6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:37.717474 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-787776ae-0eb0-4712-8951-1d79dcdfd5f6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:37.724179 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-787776ae-0eb0-4712-8951-1d79dcdfd5f6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:37.725015 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-787776ae-0eb0-4712-8951-1d79dcdfd5f6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:37.726027 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-787776ae-0eb0-4712-8951-1d79dcdfd5f6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:37.726721 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-787776ae-0eb0-4712-8951-1d79dcdfd5f6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:37.879314 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-6d352819-feea-45ad-9bc2-7edd59fa7970 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:37.880627 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-6d352819-feea-45ad-9bc2-7edd59fa7970 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:37.894931 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d352819-feea-45ad-9bc2-7edd59fa7970 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:37.896045 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d352819-feea-45ad-9bc2-7edd59fa7970 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:37.897141 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d352819-feea-45ad-9bc2-7edd59fa7970 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:37.897993 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-6d352819-feea-45ad-9bc2-7edd59fa7970 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:37.913788 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-787776ae-0eb0-4712-8951-1d79dcdfd5f6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:37.929009 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-787776ae-0eb0-4712-8951-1d79dcdfd5f6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1265 microversion: 2.1 time: 0.212429 May 17 17:17:37.931497 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 509/983] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:37 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:37.993124 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6d352819-feea-45ad-9bc2-7edd59fa7970 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:38.003294 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6d352819-feea-45ad-9bc2-7edd59fa7970 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:38.005116 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-6d352819-feea-45ad-9bc2-7edd59fa7970 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:38.006295 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-6d352819-feea-45ad-9bc2-7edd59fa7970 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1658 microversion: 2.20 time: 0.132432 May 17 17:17:38.014270 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 475/984] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:17:37 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1658 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:17:38.097497 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-07c131bb-8aca-4308-a2bd-4390f282fd5b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:38.099398 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-07c131bb-8aca-4308-a2bd-4390f282fd5b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:38.109445 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-07c131bb-8aca-4308-a2bd-4390f282fd5b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:38.110075 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-07c131bb-8aca-4308-a2bd-4390f282fd5b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:38.120406 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-07c131bb-8aca-4308-a2bd-4390f282fd5b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:38.121134 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-07c131bb-8aca-4308-a2bd-4390f282fd5b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:38.188353 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-7d597c94-b909-4282-ae6b-173b1328d128 req-f2597f1c-66a9-4bf9-8972-801cb53f617e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6de88f8-538f-45eb-bfcd-fce744a5c55d", "name": "network-vif-deleted", "tag": "e349ab19-ab43-4bf5-8128-4ce8f8b7a5f5"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:17:38.228118 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-7d597c94-b909-4282-ae6b-173b1328d128 req-f2597f1c-66a9-4bf9-8972-801cb53f617e service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:38.229303 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-7d597c94-b909-4282-ae6b-173b1328d128 req-f2597f1c-66a9-4bf9-8972-801cb53f617e service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:38.266263 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-7d597c94-b909-4282-ae6b-173b1328d128 req-f2597f1c-66a9-4bf9-8972-801cb53f617e service nova] Creating event network-vif-deleted:e349ab19-ab43-4bf5-8128-4ce8f8b7a5f5 for instance b6de88f8-538f-45eb-bfcd-fce744a5c55d on hv-cinder-84214 May 17 17:17:38.288060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-7d597c94-b909-4282-ae6b-173b1328d128 req-f2597f1c-66a9-4bf9-8972-801cb53f617e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100949 May 17 17:17:38.288060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 476/985] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:38.299528 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f6e293be-1d45-41bc-80c5-89b264ae2357 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:38.300305 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f6e293be-1d45-41bc-80c5-89b264ae2357 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:38.318798 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f6e293be-1d45-41bc-80c5-89b264ae2357 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:38.319621 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f6e293be-1d45-41bc-80c5-89b264ae2357 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:38.324238 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f6e293be-1d45-41bc-80c5-89b264ae2357 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:38.326241 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f6e293be-1d45-41bc-80c5-89b264ae2357 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:38.351529 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-07c131bb-8aca-4308-a2bd-4390f282fd5b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lazy-loading 'services' on Instance uuid b233a28b-810a-4304-a7cb-93b1c24f76fe {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:17:38.509489 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-07c131bb-8aca-4308-a2bd-4390f282fd5b tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments/d541edc0-07cf-4dd6-85ed-af25a6916c38" status: 202 len: 0 microversion: 2.1 time: 0.415211 May 17 17:17:38.512512 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 510/986] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 17 17:17:38 2022] DELETE /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments/d541edc0-07cf-4dd6-85ed-af25a6916c38 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:17:38.528996 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-f6e293be-1d45-41bc-80c5-89b264ae2357 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:38.546245 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1315bd30-5d1f-475f-8da4-11c4b13d1f70 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:38.547414 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1315bd30-5d1f-475f-8da4-11c4b13d1f70 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:38.550721 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f6e293be-1d45-41bc-80c5-89b264ae2357 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1317 microversion: 2.1 time: 0.255116 May 17 17:17:38.554152 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 477/987] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:38 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:38.571852 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1315bd30-5d1f-475f-8da4-11c4b13d1f70 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:38.573584 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1315bd30-5d1f-475f-8da4-11c4b13d1f70 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:38.574461 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1315bd30-5d1f-475f-8da4-11c4b13d1f70 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:38.574895 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1315bd30-5d1f-475f-8da4-11c4b13d1f70 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:38.646590 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1315bd30-5d1f-475f-8da4-11c4b13d1f70 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130361 May 17 17:17:38.648094 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 511/988] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:17:38 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:38.950333 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-31781e70-a8db-40fa-a712-d12183eeb9fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:38.950903 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-31781e70-a8db-40fa-a712-d12183eeb9fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:38.957104 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-31781e70-a8db-40fa-a712-d12183eeb9fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:38.957563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-31781e70-a8db-40fa-a712-d12183eeb9fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:38.958344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-31781e70-a8db-40fa-a712-d12183eeb9fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:38.958816 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-31781e70-a8db-40fa-a712-d12183eeb9fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:39.024806 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9b5ad924-887d-4c78-8424-e5ccc9ed6109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:39.025364 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9b5ad924-887d-4c78-8424-e5ccc9ed6109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:39.032640 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9b5ad924-887d-4c78-8424-e5ccc9ed6109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:39.033094 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9b5ad924-887d-4c78-8424-e5ccc9ed6109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:39.034054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9b5ad924-887d-4c78-8424-e5ccc9ed6109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:39.034655 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9b5ad924-887d-4c78-8424-e5ccc9ed6109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:39.098781 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9b5ad924-887d-4c78-8424-e5ccc9ed6109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:39.099422 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9b5ad924-887d-4c78-8424-e5ccc9ed6109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:39.100103 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-9b5ad924-887d-4c78-8424-e5ccc9ed6109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lazy-loading 'fault' on Instance uuid b6de88f8-538f-45eb-bfcd-fce744a5c55d {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:17:39.125986 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-31781e70-a8db-40fa-a712-d12183eeb9fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:39.138747 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-31781e70-a8db-40fa-a712-d12183eeb9fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1265 microversion: 2.1 time: 0.193114 May 17 17:17:39.148541 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 478/989] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:38 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:39.180900 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9b5ad924-887d-4c78-8424-e5ccc9ed6109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:39.189577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9b5ad924-887d-4c78-8424-e5ccc9ed6109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:39.192146 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-9b5ad924-887d-4c78-8424-e5ccc9ed6109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:39.193623 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9b5ad924-887d-4c78-8424-e5ccc9ed6109 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1372 microversion: 2.20 time: 0.172975 May 17 17:17:39.194384 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 512/990] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:17:39 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:17:39.570913 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-5891b5d5-1af4-46cc-af4f-8b308afcf455 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:39.571427 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-5891b5d5-1af4-46cc-af4f-8b308afcf455 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:39.579324 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5891b5d5-1af4-46cc-af4f-8b308afcf455 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:39.580257 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5891b5d5-1af4-46cc-af4f-8b308afcf455 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:39.581341 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5891b5d5-1af4-46cc-af4f-8b308afcf455 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:39.582105 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-5891b5d5-1af4-46cc-af4f-8b308afcf455 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:39.658522 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-4bda530b-3d4d-411a-bec2-029a7ea2b1a0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:39.659661 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-4bda530b-3d4d-411a-bec2-029a7ea2b1a0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:39.665811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4bda530b-3d4d-411a-bec2-029a7ea2b1a0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:39.667105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4bda530b-3d4d-411a-bec2-029a7ea2b1a0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:39.668488 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4bda530b-3d4d-411a-bec2-029a7ea2b1a0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:39.669174 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-4bda530b-3d4d-411a-bec2-029a7ea2b1a0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:39.722247 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-4bda530b-3d4d-411a-bec2-029a7ea2b1a0 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067603 May 17 17:17:39.726710 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 513/991] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:17:39 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:39.773392 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-5891b5d5-1af4-46cc-af4f-8b308afcf455 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:39.785394 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-5891b5d5-1af4-46cc-af4f-8b308afcf455 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.218746 May 17 17:17:39.803460 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 479/992] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:39 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:40.165098 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-afa252d6-b940-4943-99b6-ea97f3eecfde tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:40.165772 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-afa252d6-b940-4943-99b6-ea97f3eecfde tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:40.174245 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-afa252d6-b940-4943-99b6-ea97f3eecfde tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:40.174700 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-afa252d6-b940-4943-99b6-ea97f3eecfde tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:40.175485 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-afa252d6-b940-4943-99b6-ea97f3eecfde tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:40.176018 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-afa252d6-b940-4943-99b6-ea97f3eecfde tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:40.214437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e931a8af-873b-4edf-b14b-664584ae568d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:40.215083 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e931a8af-873b-4edf-b14b-664584ae568d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:40.239357 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e931a8af-873b-4edf-b14b-664584ae568d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:40.239867 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e931a8af-873b-4edf-b14b-664584ae568d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:40.240630 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e931a8af-873b-4edf-b14b-664584ae568d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:40.241068 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e931a8af-873b-4edf-b14b-664584ae568d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:40.290985 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e931a8af-873b-4edf-b14b-664584ae568d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:40.291512 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e931a8af-873b-4edf-b14b-664584ae568d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:40.292011 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-e931a8af-873b-4edf-b14b-664584ae568d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lazy-loading 'fault' on Instance uuid b6de88f8-538f-45eb-bfcd-fce744a5c55d {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:17:40.361751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e931a8af-873b-4edf-b14b-664584ae568d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:40.374414 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e931a8af-873b-4edf-b14b-664584ae568d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:40.376777 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e931a8af-873b-4edf-b14b-664584ae568d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:40.378009 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e931a8af-873b-4edf-b14b-664584ae568d tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1372 microversion: 2.20 time: 0.168086 May 17 17:17:40.392729 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 480/993] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:17:40 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:17:40.411531 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-afa252d6-b940-4943-99b6-ea97f3eecfde tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:40.421161 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-afa252d6-b940-4943-99b6-ea97f3eecfde tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1265 microversion: 2.1 time: 0.266866 May 17 17:17:40.424549 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 514/994] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:40 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:40.735192 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-fdca3f89-8a18-47ff-a864-7582e1a4da15 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:40.736206 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-fdca3f89-8a18-47ff-a864-7582e1a4da15 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:40.748862 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fdca3f89-8a18-47ff-a864-7582e1a4da15 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:40.749516 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fdca3f89-8a18-47ff-a864-7582e1a4da15 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:40.750610 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fdca3f89-8a18-47ff-a864-7582e1a4da15 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:40.751304 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fdca3f89-8a18-47ff-a864-7582e1a4da15 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:40.802524 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2f09a5f4-5549-4fb1-93c3-669f37af3cc5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:40.803591 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2f09a5f4-5549-4fb1-93c3-669f37af3cc5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:40.814944 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2f09a5f4-5549-4fb1-93c3-669f37af3cc5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:40.815447 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2f09a5f4-5549-4fb1-93c3-669f37af3cc5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:40.816505 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2f09a5f4-5549-4fb1-93c3-669f37af3cc5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:40.817634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2f09a5f4-5549-4fb1-93c3-669f37af3cc5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:40.839426 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-fdca3f89-8a18-47ff-a864-7582e1a4da15 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108079 May 17 17:17:40.851044 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 481/995] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:17:40 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:17:41.032965 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2f09a5f4-5549-4fb1-93c3-669f37af3cc5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:41.040593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2f09a5f4-5549-4fb1-93c3-669f37af3cc5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.242208 May 17 17:17:41.041179 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 515/996] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:40 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:17:41.399681 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a6447fc1-1180-49d5-9d72-7637978756fd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:41.400642 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a6447fc1-1180-49d5-9d72-7637978756fd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:41.419969 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a6447fc1-1180-49d5-9d72-7637978756fd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:41.428843 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a6447fc1-1180-49d5-9d72-7637978756fd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:41.429937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a6447fc1-1180-49d5-9d72-7637978756fd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:41.430652 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a6447fc1-1180-49d5-9d72-7637978756fd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:41.442518 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-976397dc-4b48-4e20-a729-ac566a6ea5fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:41.443283 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-976397dc-4b48-4e20-a729-ac566a6ea5fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:41.462978 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-976397dc-4b48-4e20-a729-ac566a6ea5fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:41.464194 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-976397dc-4b48-4e20-a729-ac566a6ea5fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:41.469622 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-976397dc-4b48-4e20-a729-ac566a6ea5fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:41.470404 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-976397dc-4b48-4e20-a729-ac566a6ea5fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:41.497397 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a6447fc1-1180-49d5-9d72-7637978756fd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:41.498606 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a6447fc1-1180-49d5-9d72-7637978756fd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:41.499402 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-a6447fc1-1180-49d5-9d72-7637978756fd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lazy-loading 'fault' on Instance uuid b6de88f8-538f-45eb-bfcd-fce744a5c55d {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:17:41.652501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a6447fc1-1180-49d5-9d72-7637978756fd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:41.669420 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a6447fc1-1180-49d5-9d72-7637978756fd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:41.671401 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a6447fc1-1180-49d5-9d72-7637978756fd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:41.681667 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a6447fc1-1180-49d5-9d72-7637978756fd tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1372 microversion: 2.20 time: 0.280506 May 17 17:17:41.683276 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 482/997] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:17:41 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1372 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:17:41.773537 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-976397dc-4b48-4e20-a729-ac566a6ea5fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:41.783092 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-976397dc-4b48-4e20-a729-ac566a6ea5fb tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1265 microversion: 2.1 time: 0.344471 May 17 17:17:41.784483 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 516/998] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:41 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1265 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:41.860314 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2f6327d9-6435-4c0a-b58c-522476234086 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:41.861247 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2f6327d9-6435-4c0a-b58c-522476234086 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:41.870282 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2f6327d9-6435-4c0a-b58c-522476234086 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:41.870741 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2f6327d9-6435-4c0a-b58c-522476234086 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:41.871978 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2f6327d9-6435-4c0a-b58c-522476234086 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:41.872420 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2f6327d9-6435-4c0a-b58c-522476234086 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:41.908496 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2f6327d9-6435-4c0a-b58c-522476234086 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053113 May 17 17:17:41.909377 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 483/999] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:17:41 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:42.059332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-526545b7-be88-4c68-a877-f0fe9cf7ca15 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:42.060001 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-526545b7-be88-4c68-a877-f0fe9cf7ca15 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:42.066201 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-526545b7-be88-4c68-a877-f0fe9cf7ca15 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:42.066858 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-526545b7-be88-4c68-a877-f0fe9cf7ca15 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:42.068059 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-526545b7-be88-4c68-a877-f0fe9cf7ca15 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:42.068941 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-526545b7-be88-4c68-a877-f0fe9cf7ca15 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:42.250448 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-526545b7-be88-4c68-a877-f0fe9cf7ca15 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:42.258497 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-526545b7-be88-4c68-a877-f0fe9cf7ca15 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.204159 May 17 17:17:42.269932 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 517/1000] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:42 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:42.703147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b043a369-447f-4ff5-8529-e9a1aa6ad310 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:42.703993 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-b043a369-447f-4ff5-8529-e9a1aa6ad310 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:42.710941 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b043a369-447f-4ff5-8529-e9a1aa6ad310 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:42.712025 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b043a369-447f-4ff5-8529-e9a1aa6ad310 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:42.714251 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b043a369-447f-4ff5-8529-e9a1aa6ad310 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:42.714988 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b043a369-447f-4ff5-8529-e9a1aa6ad310 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:42.767180 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b043a369-447f-4ff5-8529-e9a1aa6ad310 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:42.768028 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b043a369-447f-4ff5-8529-e9a1aa6ad310 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:42.769750 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-b043a369-447f-4ff5-8529-e9a1aa6ad310 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lazy-loading 'fault' on Instance uuid b6de88f8-538f-45eb-bfcd-fce744a5c55d {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:17:42.802369 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-39569895-1e95-4972-9f59-981ab73e7b74 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:42.802987 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-39569895-1e95-4972-9f59-981ab73e7b74 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:42.815594 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-39569895-1e95-4972-9f59-981ab73e7b74 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:42.817672 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-39569895-1e95-4972-9f59-981ab73e7b74 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:42.819687 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-39569895-1e95-4972-9f59-981ab73e7b74 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:42.820403 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-39569895-1e95-4972-9f59-981ab73e7b74 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:42.880161 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-b043a369-447f-4ff5-8529-e9a1aa6ad310 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:42.892023 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-b043a369-447f-4ff5-8529-e9a1aa6ad310 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:42.893666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-b043a369-447f-4ff5-8529-e9a1aa6ad310 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:42.895081 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-b043a369-447f-4ff5-8529-e9a1aa6ad310 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1372 microversion: 2.20 time: 0.197477 May 17 17:17:42.896201 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 484/1001] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:17:42 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1372 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:17:42.922449 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8830814b-c06e-4812-ab52-d3698fcfac1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:42.923720 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8830814b-c06e-4812-ab52-d3698fcfac1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:42.942549 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8830814b-c06e-4812-ab52-d3698fcfac1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:42.943402 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8830814b-c06e-4812-ab52-d3698fcfac1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:42.944663 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8830814b-c06e-4812-ab52-d3698fcfac1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:42.945333 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8830814b-c06e-4812-ab52-d3698fcfac1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:42.987234 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8830814b-c06e-4812-ab52-d3698fcfac1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070466 May 17 17:17:42.988567 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 485/1002] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:17:42 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:17:42.997264 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-d610b00a-c8cd-4256-ae0d-43cf195549aa req-7dca17fa-bc88-467b-800c-e900101ae459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82812c49-fa86-43cc-ab6f-2df6bf74dfd8", "name": "network-vif-plugged", "status": "completed", "tag": "69a028cd-6a7e-49ed-93d6-e5229bb69b2c"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:17:43.006514 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-d610b00a-c8cd-4256-ae0d-43cf195549aa req-7dca17fa-bc88-467b-800c-e900101ae459 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:43.007069 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-d610b00a-c8cd-4256-ae0d-43cf195549aa req-7dca17fa-bc88-467b-800c-e900101ae459 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:43.032896 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-d610b00a-c8cd-4256-ae0d-43cf195549aa req-7dca17fa-bc88-467b-800c-e900101ae459 service nova] Creating event network-vif-plugged:69a028cd-6a7e-49ed-93d6-e5229bb69b2c for instance 82812c49-fa86-43cc-ab6f-2df6bf74dfd8 on hv-cinder-84214 May 17 17:17:43.053724 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-d610b00a-c8cd-4256-ae0d-43cf195549aa req-7dca17fa-bc88-467b-800c-e900101ae459 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055147 May 17 17:17:43.054726 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 486/1003] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:43.146275 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-39569895-1e95-4972-9f59-981ab73e7b74 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:43.157743 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-39569895-1e95-4972-9f59-981ab73e7b74 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1265 microversion: 2.1 time: 0.360061 May 17 17:17:43.158583 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 518/1004] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:42 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1265 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:17:43.278613 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1726fa2e-d18d-4ee5-9f87-7a221c80b04d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:43.279591 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1726fa2e-d18d-4ee5-9f87-7a221c80b04d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:43.286921 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1726fa2e-d18d-4ee5-9f87-7a221c80b04d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:43.287379 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1726fa2e-d18d-4ee5-9f87-7a221c80b04d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:43.288462 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1726fa2e-d18d-4ee5-9f87-7a221c80b04d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:43.288955 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1726fa2e-d18d-4ee5-9f87-7a221c80b04d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:43.538670 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1726fa2e-d18d-4ee5-9f87-7a221c80b04d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:43.547964 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1726fa2e-d18d-4ee5-9f87-7a221c80b04d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.274190 May 17 17:17:43.549193 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 487/1005] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:43 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:43.914607 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5fe4bb58-d220-4cf9-aa3a-92d7abedd0ec tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:43.915220 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5fe4bb58-d220-4cf9-aa3a-92d7abedd0ec tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:43.923139 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5fe4bb58-d220-4cf9-aa3a-92d7abedd0ec tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:43.923980 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5fe4bb58-d220-4cf9-aa3a-92d7abedd0ec tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:43.924982 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5fe4bb58-d220-4cf9-aa3a-92d7abedd0ec tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:43.925641 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5fe4bb58-d220-4cf9-aa3a-92d7abedd0ec tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:43.962180 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5fe4bb58-d220-4cf9-aa3a-92d7abedd0ec tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:43.962959 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5fe4bb58-d220-4cf9-aa3a-92d7abedd0ec tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:43.964528 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-5fe4bb58-d220-4cf9-aa3a-92d7abedd0ec tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lazy-loading 'fault' on Instance uuid b6de88f8-538f-45eb-bfcd-fce744a5c55d {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:17:43.999029 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-979cf02b-ecbe-4377-88ba-bde7c53f8506 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:44.000730 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-979cf02b-ecbe-4377-88ba-bde7c53f8506 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:44.013933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-979cf02b-ecbe-4377-88ba-bde7c53f8506 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:44.014877 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-979cf02b-ecbe-4377-88ba-bde7c53f8506 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:44.019164 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-979cf02b-ecbe-4377-88ba-bde7c53f8506 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:44.019164 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-979cf02b-ecbe-4377-88ba-bde7c53f8506 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:44.040015 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5fe4bb58-d220-4cf9-aa3a-92d7abedd0ec tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:44.053556 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5fe4bb58-d220-4cf9-aa3a-92d7abedd0ec tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:44.064811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5fe4bb58-d220-4cf9-aa3a-92d7abedd0ec tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:44.066599 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5fe4bb58-d220-4cf9-aa3a-92d7abedd0ec tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1372 microversion: 2.20 time: 0.155998 May 17 17:17:44.067624 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 519/1006] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:17:43 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:17:44.080617 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-979cf02b-ecbe-4377-88ba-bde7c53f8506 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083496 May 17 17:17:44.082659 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 488/1007] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:17:43 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:17:44.175173 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-dfdcecac-a592-4ee6-b255-38aa0fe7e6aa tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:44.175856 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-dfdcecac-a592-4ee6-b255-38aa0fe7e6aa tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:44.182294 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dfdcecac-a592-4ee6-b255-38aa0fe7e6aa tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:44.187930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dfdcecac-a592-4ee6-b255-38aa0fe7e6aa tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:44.188829 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dfdcecac-a592-4ee6-b255-38aa0fe7e6aa tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:44.189277 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dfdcecac-a592-4ee6-b255-38aa0fe7e6aa tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:44.445385 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-dfdcecac-a592-4ee6-b255-38aa0fe7e6aa tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:44.454913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-dfdcecac-a592-4ee6-b255-38aa0fe7e6aa tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1265 microversion: 2.1 time: 0.283915 May 17 17:17:44.456002 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 520/1008] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:44 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:44.566042 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d00ec155-9d4a-4597-86d4-bca1ff2bc769 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:44.566772 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d00ec155-9d4a-4597-86d4-bca1ff2bc769 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:44.574874 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d00ec155-9d4a-4597-86d4-bca1ff2bc769 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:44.576278 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d00ec155-9d4a-4597-86d4-bca1ff2bc769 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:44.577579 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d00ec155-9d4a-4597-86d4-bca1ff2bc769 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:44.578330 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d00ec155-9d4a-4597-86d4-bca1ff2bc769 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:44.794361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d00ec155-9d4a-4597-86d4-bca1ff2bc769 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:44.801982 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d00ec155-9d4a-4597-86d4-bca1ff2bc769 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.239691 May 17 17:17:44.802607 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 489/1009] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:44 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:45.086269 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-d6883293-a1ac-4db8-bfef-7f51e697dda2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:45.087638 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-d6883293-a1ac-4db8-bfef-7f51e697dda2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:45.092085 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2f98c6cf-90d3-4949-861d-d72c6bb590a7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:45.093009 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2f98c6cf-90d3-4949-861d-d72c6bb590a7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:45.102571 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d6883293-a1ac-4db8-bfef-7f51e697dda2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:45.103330 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d6883293-a1ac-4db8-bfef-7f51e697dda2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:45.110505 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2f98c6cf-90d3-4949-861d-d72c6bb590a7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:45.110950 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2f98c6cf-90d3-4949-861d-d72c6bb590a7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:45.111777 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2f98c6cf-90d3-4949-861d-d72c6bb590a7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:45.112218 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2f98c6cf-90d3-4949-861d-d72c6bb590a7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:45.112557 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d6883293-a1ac-4db8-bfef-7f51e697dda2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:45.113090 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d6883293-a1ac-4db8-bfef-7f51e697dda2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:45.171219 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2f98c6cf-90d3-4949-861d-d72c6bb590a7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083114 May 17 17:17:45.171647 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d6883293-a1ac-4db8-bfef-7f51e697dda2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:45.172146 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 490/1010] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:17:45 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:45.172563 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-d6883293-a1ac-4db8-bfef-7f51e697dda2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:45.173260 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-d6883293-a1ac-4db8-bfef-7f51e697dda2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lazy-loading 'fault' on Instance uuid b6de88f8-538f-45eb-bfcd-fce744a5c55d {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:17:45.230047 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d6883293-a1ac-4db8-bfef-7f51e697dda2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:45.238334 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d6883293-a1ac-4db8-bfef-7f51e697dda2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:45.240280 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-d6883293-a1ac-4db8-bfef-7f51e697dda2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:45.241841 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-d6883293-a1ac-4db8-bfef-7f51e697dda2 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1372 microversion: 2.20 time: 0.159486 May 17 17:17:45.251679 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 521/1011] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:17:45 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:17:45.475185 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-8517d243-6b7e-4308-87e3-3f246e0d2a1f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:45.475767 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-8517d243-6b7e-4308-87e3-3f246e0d2a1f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:45.490261 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8517d243-6b7e-4308-87e3-3f246e0d2a1f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:45.490872 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8517d243-6b7e-4308-87e3-3f246e0d2a1f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:45.491836 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8517d243-6b7e-4308-87e3-3f246e0d2a1f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:45.492836 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-8517d243-6b7e-4308-87e3-3f246e0d2a1f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:45.730607 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-8517d243-6b7e-4308-87e3-3f246e0d2a1f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:45.741508 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-8517d243-6b7e-4308-87e3-3f246e0d2a1f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1265 microversion: 2.1 time: 0.271465 May 17 17:17:45.742104 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 491/1012] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:45 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:45.822212 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a8e9ff89-fcf0-4053-82b3-8c74a9f2473c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:45.822905 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a8e9ff89-fcf0-4053-82b3-8c74a9f2473c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:45.832592 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8e9ff89-fcf0-4053-82b3-8c74a9f2473c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:45.832809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8e9ff89-fcf0-4053-82b3-8c74a9f2473c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:45.833618 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8e9ff89-fcf0-4053-82b3-8c74a9f2473c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:45.834053 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8e9ff89-fcf0-4053-82b3-8c74a9f2473c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:46.005947 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a8e9ff89-fcf0-4053-82b3-8c74a9f2473c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:46.022247 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a8e9ff89-fcf0-4053-82b3-8c74a9f2473c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.203948 May 17 17:17:46.023397 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 522/1013] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:45 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:46.183288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-61fef01a-43c0-4470-b043-9015e179f4b1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:46.184427 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-61fef01a-43c0-4470-b043-9015e179f4b1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:46.192536 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-61fef01a-43c0-4470-b043-9015e179f4b1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:46.193409 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-61fef01a-43c0-4470-b043-9015e179f4b1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:46.193882 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-61fef01a-43c0-4470-b043-9015e179f4b1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:46.194487 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-61fef01a-43c0-4470-b043-9015e179f4b1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:46.225566 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-61fef01a-43c0-4470-b043-9015e179f4b1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047027 May 17 17:17:46.226177 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 492/1014] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:17:46 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:46.261286 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a77aa590-c4cf-4f7d-bafd-ea55860293f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:46.262133 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a77aa590-c4cf-4f7d-bafd-ea55860293f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:46.268947 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a77aa590-c4cf-4f7d-bafd-ea55860293f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:46.269391 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a77aa590-c4cf-4f7d-bafd-ea55860293f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:46.270167 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a77aa590-c4cf-4f7d-bafd-ea55860293f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:46.270596 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a77aa590-c4cf-4f7d-bafd-ea55860293f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:46.310530 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a77aa590-c4cf-4f7d-bafd-ea55860293f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:46.310986 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a77aa590-c4cf-4f7d-bafd-ea55860293f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:46.311437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-a77aa590-c4cf-4f7d-bafd-ea55860293f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lazy-loading 'fault' on Instance uuid b6de88f8-538f-45eb-bfcd-fce744a5c55d {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:17:46.357138 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a77aa590-c4cf-4f7d-bafd-ea55860293f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:46.366385 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a77aa590-c4cf-4f7d-bafd-ea55860293f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:46.367950 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a77aa590-c4cf-4f7d-bafd-ea55860293f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86a0b6c88fe84ba0907d515fd9f38e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d587d1ef11b4055b77055e6fbcc1899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:46.369073 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a77aa590-c4cf-4f7d-bafd-ea55860293f7 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 200 len: 1372 microversion: 2.20 time: 0.112478 May 17 17:17:46.369682 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 523/1015] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:17:46 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:17:46.759793 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-798ff94c-c151-489c-9ce0-6de7e5c991be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:46.760958 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-798ff94c-c151-489c-9ce0-6de7e5c991be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:46.766864 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-798ff94c-c151-489c-9ce0-6de7e5c991be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:46.767245 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-798ff94c-c151-489c-9ce0-6de7e5c991be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:46.768065 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-798ff94c-c151-489c-9ce0-6de7e5c991be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:46.768501 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-798ff94c-c151-489c-9ce0-6de7e5c991be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:46.899399 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-798ff94c-c151-489c-9ce0-6de7e5c991be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:46.909545 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-798ff94c-c151-489c-9ce0-6de7e5c991be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1265 microversion: 2.1 time: 0.153711 May 17 17:17:46.910290 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 493/1016] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:46 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:47.040839 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5c310239-b54b-403a-b25a-dac1cabd3966 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:47.042803 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5c310239-b54b-403a-b25a-dac1cabd3966 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:47.049748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5c310239-b54b-403a-b25a-dac1cabd3966 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:47.050232 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5c310239-b54b-403a-b25a-dac1cabd3966 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:47.051021 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5c310239-b54b-403a-b25a-dac1cabd3966 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:47.051454 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5c310239-b54b-403a-b25a-dac1cabd3966 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:47.198950 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5c310239-b54b-403a-b25a-dac1cabd3966 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:47.206784 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5c310239-b54b-403a-b25a-dac1cabd3966 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.171202 May 17 17:17:47.207573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 524/1017] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:47 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:47.237935 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-b15e2890-a21b-42ab-8098-efe5f173ee97 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:47.238870 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-b15e2890-a21b-42ab-8098-efe5f173ee97 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:47.245924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b15e2890-a21b-42ab-8098-efe5f173ee97 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:47.246378 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b15e2890-a21b-42ab-8098-efe5f173ee97 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:47.247175 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b15e2890-a21b-42ab-8098-efe5f173ee97 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:47.247628 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-b15e2890-a21b-42ab-8098-efe5f173ee97 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:47.288949 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-b15e2890-a21b-42ab-8098-efe5f173ee97 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054902 May 17 17:17:47.299007 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 494/1018] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:17:47 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:47.386906 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-aaa2ddb6-8f5a-4cad-bb83-028eb4d2ed35 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:47.388157 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-aaa2ddb6-8f5a-4cad-bb83-028eb4d2ed35 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:47.398239 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aaa2ddb6-8f5a-4cad-bb83-028eb4d2ed35 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:47.398682 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aaa2ddb6-8f5a-4cad-bb83-028eb4d2ed35 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:47.400450 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aaa2ddb6-8f5a-4cad-bb83-028eb4d2ed35 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:47.401724 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aaa2ddb6-8f5a-4cad-bb83-028eb4d2ed35 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:47.419670 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-aaa2ddb6-8f5a-4cad-bb83-028eb4d2ed35 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] HTTP exception thrown: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-aaa2ddb6-8f5a-4cad-bb83-028eb4d2ed35 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Request method failure captured: May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d HTTP/1.1 May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9cGE5WwJ43H7c_jXMGhJwcMbrd3z2NY1pr03NfBNQtU1euQDxsTIEhWqMMVkzERF7Elr4_qRg9ROaXHF3Pel6Jv0boZYZaXVj_GbSpJlSTAM80tyqrlX3r9a2AmsKSuKxSITU8QmnJxzKhawMrmD-LwE6JBOutaQJxU6fBEvGobAW8 May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Openstack-Nova-Api-Version: 2.20 May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 9d587d1ef11b4055b77055e6fbcc1899 May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:17:47.421930 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:17:47.423663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:47.423663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:47.423663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 9d587d1ef11b4055b77055e6fbcc1899 May 17 17:17:47.423663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:47.423663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-AttachVolumeShelveTestJSON-1404132781-project May 17 17:17:47.423663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:17:47.423663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:17:47.423663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 86a0b6c88fe84ba0907d515fd9f38e72 May 17 17:17:47.423663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1404132781-project May 17 17:17:47.423663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:17:47.423663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:47.423663 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': 'b6de88f8-538f-45eb-bfcd-fce744a5c55d'} May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:47.424651 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:47.428370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:47.429775 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-aaa2ddb6-8f5a-4cad-bb83-028eb4d2ed35 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Returning 404 to user: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:47.429775 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-aaa2ddb6-8f5a-4cad-bb83-028eb4d2ed35 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 404 len: 111 microversion: 2.20 time: 0.040514 May 17 17:17:47.429775 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 525/1019] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:17:47 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 17:17:47.433290 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-df18a989-5760-40a2-908a-a29b727be11c req-8a379867-ced3-428a-b4fa-dfec1693ce8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa95d7a-9071-46b7-bff5-c6d3fa54d1d3", "tag": "71199a70-f362-4ec1-8023-8d7cd045f666"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:17:47.446832 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-df18a989-5760-40a2-908a-a29b727be11c req-8a379867-ced3-428a-b4fa-dfec1693ce8f service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:47.446832 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-df18a989-5760-40a2-908a-a29b727be11c req-8a379867-ced3-428a-b4fa-dfec1693ce8f service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:47.449853 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-59fcd23e-32e0-4a13-8768-34734cc6964a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '.version_select at 0x7feb12fec8b0>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:47.458114 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-df18a989-5760-40a2-908a-a29b727be11c req-8a379867-ced3-428a-b4fa-dfec1693ce8f service nova] Creating event network-changed:71199a70-f362-4ec1-8023-8d7cd045f666 for instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 on hv-cinder-84214 May 17 17:17:47.464125 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-df18a989-5760-40a2-908a-a29b727be11c req-8a379867-ced3-428a-b4fa-dfec1693ce8f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035231 May 17 17:17:47.464980 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 495/1020] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:47.479210 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-59fcd23e-32e0-4a13-8768-34734cc6964a tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1223346154" status: 204 len: 0 microversion: 2.20 time: 0.039566 May 17 17:17:47.480382 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 526/1021] 10.222.0.48 () {60 vars in 1261 bytes} [Tue May 17 17:17:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1223346154 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 17:17:47.927616 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a9fe1172-766a-4d9d-904f-f9f1fabffb50 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:47.928325 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a9fe1172-766a-4d9d-904f-f9f1fabffb50 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:47.934526 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9fe1172-766a-4d9d-904f-f9f1fabffb50 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:47.934977 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9fe1172-766a-4d9d-904f-f9f1fabffb50 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:47.935835 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9fe1172-766a-4d9d-904f-f9f1fabffb50 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:47.936274 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9fe1172-766a-4d9d-904f-f9f1fabffb50 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:48.076193 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a9fe1172-766a-4d9d-904f-f9f1fabffb50 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:48.083546 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a9fe1172-766a-4d9d-904f-f9f1fabffb50 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1265 microversion: 2.1 time: 0.160148 May 17 17:17:48.084129 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 496/1022] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:47 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:48.224086 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-89094f9f-7a73-45f5-9af5-0b9fe3378480 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:48.224703 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-89094f9f-7a73-45f5-9af5-0b9fe3378480 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:48.231332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-89094f9f-7a73-45f5-9af5-0b9fe3378480 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:48.231812 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-89094f9f-7a73-45f5-9af5-0b9fe3378480 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:48.232586 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-89094f9f-7a73-45f5-9af5-0b9fe3378480 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:48.233028 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-89094f9f-7a73-45f5-9af5-0b9fe3378480 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:48.309981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a9b99446-0b99-4c8a-abd7-1e45fd15ed50 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:48.310735 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a9b99446-0b99-4c8a-abd7-1e45fd15ed50 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:48.327123 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9b99446-0b99-4c8a-abd7-1e45fd15ed50 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:48.327847 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9b99446-0b99-4c8a-abd7-1e45fd15ed50 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:48.328884 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9b99446-0b99-4c8a-abd7-1e45fd15ed50 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:48.332180 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9b99446-0b99-4c8a-abd7-1e45fd15ed50 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:48.362847 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a9b99446-0b99-4c8a-abd7-1e45fd15ed50 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057693 May 17 17:17:48.368095 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 497/1023] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:17:48 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 17 17:17:48.384814 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-89094f9f-7a73-45f5-9af5-0b9fe3378480 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:48.411822 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-89094f9f-7a73-45f5-9af5-0b9fe3378480 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.191291 May 17 17:17:48.414855 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 527/1024] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:48 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:48.447832 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d6418b2c-af92-4643-bf1d-bbdc4d3ecb92 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:48.448464 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d6418b2c-af92-4643-bf1d-bbdc4d3ecb92 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:48.463869 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d6418b2c-af92-4643-bf1d-bbdc4d3ecb92 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:48.464323 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d6418b2c-af92-4643-bf1d-bbdc4d3ecb92 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:48.465109 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d6418b2c-af92-4643-bf1d-bbdc4d3ecb92 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:48.465548 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d6418b2c-af92-4643-bf1d-bbdc4d3ecb92 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:48.495278 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d6418b2c-af92-4643-bf1d-bbdc4d3ecb92 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Going to try to terminate instance {{(pid=117089) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:17:48.570939 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d6418b2c-af92-4643-bf1d-bbdc4d3ecb92 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 204 len: 0 microversion: 2.1 time: 0.129165 May 17 17:17:48.571526 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 498/1025] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:17:48 2022] DELETE /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:17:48.579912 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1afa4d67-00e4-4b3a-8399-c63d95bba7a1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:48.580464 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1afa4d67-00e4-4b3a-8399-c63d95bba7a1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:48.586625 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1afa4d67-00e4-4b3a-8399-c63d95bba7a1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:48.587094 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1afa4d67-00e4-4b3a-8399-c63d95bba7a1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:48.588411 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1afa4d67-00e4-4b3a-8399-c63d95bba7a1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:48.588845 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1afa4d67-00e4-4b3a-8399-c63d95bba7a1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:48.718570 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1afa4d67-00e4-4b3a-8399-c63d95bba7a1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:48.725995 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1afa4d67-00e4-4b3a-8399-c63d95bba7a1 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1680 microversion: 2.1 time: 0.150032 May 17 17:17:48.726558 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 528/1026] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:48 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:49.101982 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-01e4fae1-25b2-4980-b0ca-dbe59d7e55f2 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:49.102770 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-01e4fae1-25b2-4980-b0ca-dbe59d7e55f2 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:49.109243 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-01e4fae1-25b2-4980-b0ca-dbe59d7e55f2 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:49.109754 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-01e4fae1-25b2-4980-b0ca-dbe59d7e55f2 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:49.110626 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-01e4fae1-25b2-4980-b0ca-dbe59d7e55f2 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:49.110963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-01e4fae1-25b2-4980-b0ca-dbe59d7e55f2 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:49.247804 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-01e4fae1-25b2-4980-b0ca-dbe59d7e55f2 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:49.255160 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-01e4fae1-25b2-4980-b0ca-dbe59d7e55f2 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1452 microversion: 2.1 time: 0.157821 May 17 17:17:49.255738 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 499/1027] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:49 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:49.271652 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-aff249dc-6f97-48e8-af47-f65837214a8d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:49.272273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-aff249dc-6f97-48e8-af47-f65837214a8d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:49.278472 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aff249dc-6f97-48e8-af47-f65837214a8d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:49.278927 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aff249dc-6f97-48e8-af47-f65837214a8d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:49.279737 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aff249dc-6f97-48e8-af47-f65837214a8d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:49.280178 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-aff249dc-6f97-48e8-af47-f65837214a8d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:49.416586 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-aff249dc-6f97-48e8-af47-f65837214a8d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:49.424403 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-aff249dc-6f97-48e8-af47-f65837214a8d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1452 microversion: 2.1 time: 0.156708 May 17 17:17:49.425251 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 529/1028] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:49 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:49.430296 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3e157999-cd24-4e9a-943c-fa9f117d271f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:49.431005 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3e157999-cd24-4e9a-943c-fa9f117d271f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:49.438146 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3e157999-cd24-4e9a-943c-fa9f117d271f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:49.438605 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3e157999-cd24-4e9a-943c-fa9f117d271f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:49.439383 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3e157999-cd24-4e9a-943c-fa9f117d271f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:49.439851 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3e157999-cd24-4e9a-943c-fa9f117d271f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:49.489444 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-53b4a2ec-a772-407d-8fa4-9e4a1643357c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:49.489939 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-53b4a2ec-a772-407d-8fa4-9e4a1643357c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:49.496893 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-53b4a2ec-a772-407d-8fa4-9e4a1643357c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:49.497590 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-53b4a2ec-a772-407d-8fa4-9e4a1643357c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:49.498565 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-53b4a2ec-a772-407d-8fa4-9e4a1643357c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:49.498986 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-53b4a2ec-a772-407d-8fa4-9e4a1643357c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:49.528240 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-53b4a2ec-a772-407d-8fa4-9e4a1643357c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] HTTP exception thrown: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-53b4a2ec-a772-407d-8fa4-9e4a1643357c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Request method failure captured: May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: DELETE /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d HTTP/1.1 May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9cGE5WwJ43H7c_jXMGhJwcMbrd3z2NY1pr03NfBNQtU1euQDxsTIEhWqMMVkzERF7Elr4_qRg9ROaXHF3Pel6Jv0boZYZaXVj_GbSpJlSTAM80tyqrlX3r9a2AmsKSuKxSITU8QmnJxzKhawMrmD-LwE6JBOutaQJxU6fBEvGobAW8 May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Openstack-Nova-Api-Version: 2.20 May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 9d587d1ef11b4055b77055e6fbcc1899 May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:17:49.529769 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:17:49.531519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:49.531519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:49.531519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 9d587d1ef11b4055b77055e6fbcc1899 May 17 17:17:49.531519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:49.531519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-AttachVolumeShelveTestJSON-1404132781-project May 17 17:17:49.531519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:17:49.531519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:17:49.531519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 86a0b6c88fe84ba0907d515fd9f38e72 May 17 17:17:49.531519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1404132781-project May 17 17:17:49.531519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:17:49.531519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:49.531519 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': 'b6de88f8-538f-45eb-bfcd-fce744a5c55d'} May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:49.532495 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:49.533990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:49.535474 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-53b4a2ec-a772-407d-8fa4-9e4a1643357c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Returning 404 to user: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:49.535474 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-53b4a2ec-a772-407d-8fa4-9e4a1643357c tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 404 len: 111 microversion: 2.20 time: 0.045562 May 17 17:17:49.535474 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 530/1029] 10.222.0.48 () {60 vars in 1279 bytes} [Tue May 17 17:17:49 2022] DELETE /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 17:17:49.540310 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7502e22c-7ce0-4be1-87de-b32250d19963 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:49.541594 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7502e22c-7ce0-4be1-87de-b32250d19963 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b6de88f8-538f-45eb-bfcd-fce744a5c55d] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:49.547785 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7502e22c-7ce0-4be1-87de-b32250d19963 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:49.548490 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7502e22c-7ce0-4be1-87de-b32250d19963 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:49.549440 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7502e22c-7ce0-4be1-87de-b32250d19963 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:49.549883 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7502e22c-7ce0-4be1-87de-b32250d19963 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:49.566229 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-7502e22c-7ce0-4be1-87de-b32250d19963 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] HTTP exception thrown: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7502e22c-7ce0-4be1-87de-b32250d19963 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Request method failure captured: May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d HTTP/1.1 May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9cGE5WwJ43H7c_jXMGhJwcMbrd3z2NY1pr03NfBNQtU1euQDxsTIEhWqMMVkzERF7Elr4_qRg9ROaXHF3Pel6Jv0boZYZaXVj_GbSpJlSTAM80tyqrlX3r9a2AmsKSuKxSITU8QmnJxzKhawMrmD-LwE6JBOutaQJxU6fBEvGobAW8 May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Openstack-Nova-Api-Version: 2.20 May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 9d587d1ef11b4055b77055e6fbcc1899 May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:17:49.567823 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:17:49.569298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:49.569298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:49.569298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 9d587d1ef11b4055b77055e6fbcc1899 May 17 17:17:49.569298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:49.569298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-AttachVolumeShelveTestJSON-1404132781-project May 17 17:17:49.569298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:17:49.569298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:17:49.569298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 86a0b6c88fe84ba0907d515fd9f38e72 May 17 17:17:49.569298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1404132781-project May 17 17:17:49.569298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:17:49.569298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:49.569298 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': 'b6de88f8-538f-45eb-bfcd-fce744a5c55d'} May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:49.570081 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. May 17 17:17:49.571332 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:49.572997 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7502e22c-7ce0-4be1-87de-b32250d19963 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Returning 404 to user: Instance b6de88f8-538f-45eb-bfcd-fce744a5c55d could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:49.572997 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7502e22c-7ce0-4be1-87de-b32250d19963 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d" status: 404 len: 111 microversion: 2.20 time: 0.032787 May 17 17:17:49.572997 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 531/1030] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:17:49 2022] GET /compute/v2.1/servers/b6de88f8-538f-45eb-bfcd-fce744a5c55d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 17:17:49.581665 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3e157999-cd24-4e9a-943c-fa9f117d271f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:49.590016 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3e157999-cd24-4e9a-943c-fa9f117d271f tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.163500 May 17 17:17:49.590664 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 500/1031] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:49 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:17:49.744876 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-03692a33-d728-4c13-8884-d3390a14a2dd tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:49.745492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-03692a33-d728-4c13-8884-d3390a14a2dd tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:49.751486 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-03692a33-d728-4c13-8884-d3390a14a2dd tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:49.752016 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-03692a33-d728-4c13-8884-d3390a14a2dd tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:49.752782 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-03692a33-d728-4c13-8884-d3390a14a2dd tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:49.753338 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-03692a33-d728-4c13-8884-d3390a14a2dd tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:49.893194 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-03692a33-d728-4c13-8884-d3390a14a2dd tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:49.901584 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-03692a33-d728-4c13-8884-d3390a14a2dd tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1680 microversion: 2.1 time: 0.161358 May 17 17:17:49.902256 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 532/1032] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:49 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:50.607328 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-69f8a40c-7ef2-4036-b1df-5b10c5f2d56c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:50.608059 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-69f8a40c-7ef2-4036-b1df-5b10c5f2d56c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:50.614540 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-69f8a40c-7ef2-4036-b1df-5b10c5f2d56c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:50.615000 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-69f8a40c-7ef2-4036-b1df-5b10c5f2d56c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:50.615809 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-69f8a40c-7ef2-4036-b1df-5b10c5f2d56c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:50.616256 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-69f8a40c-7ef2-4036-b1df-5b10c5f2d56c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:50.705702 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1fea68b4-0778-420a-ad34-64989f887620 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:50.706265 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1fea68b4-0778-420a-ad34-64989f887620 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:50.714377 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1fea68b4-0778-420a-ad34-64989f887620 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:50.715113 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1fea68b4-0778-420a-ad34-64989f887620 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:50.716255 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1fea68b4-0778-420a-ad34-64989f887620 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:50.716865 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1fea68b4-0778-420a-ad34-64989f887620 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:50.732223 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-1fea68b4-0778-420a-ad34-64989f887620 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] HTTP exception thrown: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1fea68b4-0778-420a-ad34-64989f887620 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Request method failure captured: May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: DELETE /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 HTTP/1.1 May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9cGE5WwJ43H7c_jXMGhJwcMbrd3z2NY1pr03NfBNQtU1euQDxsTIEhWqMMVkzERF7Elr4_qRg9ROaXHF3Pel6Jv0boZYZaXVj_GbSpJlSTAM80tyqrlX3r9a2AmsKSuKxSITU8QmnJxzKhawMrmD-LwE6JBOutaQJxU6fBEvGobAW8 May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Openstack-Nova-Api-Version: 2.20 May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 9d587d1ef11b4055b77055e6fbcc1899 May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:17:50.733796 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:17:50.735543 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:50.735543 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:50.735543 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 9d587d1ef11b4055b77055e6fbcc1899 May 17 17:17:50.735543 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:50.735543 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-AttachVolumeShelveTestJSON-1404132781-project May 17 17:17:50.735543 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:17:50.735543 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:17:50.735543 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 86a0b6c88fe84ba0907d515fd9f38e72 May 17 17:17:50.735543 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1404132781-project May 17 17:17:50.735543 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:17:50.735543 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:17:50.735543 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': 'b074c961-149b-4667-addc-790568769b88'} May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:50.736509 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:17:50.738106 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:50.739698 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1fea68b4-0778-420a-ad34-64989f887620 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Returning 404 to user: Instance b074c961-149b-4667-addc-790568769b88 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:50.739698 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1fea68b4-0778-420a-ad34-64989f887620 tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 404 len: 111 microversion: 2.20 time: 0.033535 May 17 17:17:50.739698 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 533/1033] 10.222.0.48 () {60 vars in 1279 bytes} [Tue May 17 17:17:50 2022] DELETE /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 17 17:17:50.743564 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5f81d380-2498-495d-9b3b-dfdc191216ab tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:50.744431 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5f81d380-2498-495d-9b3b-dfdc191216ab tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] [instance: b074c961-149b-4667-addc-790568769b88] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:50.750675 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5f81d380-2498-495d-9b3b-dfdc191216ab tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:50.751119 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5f81d380-2498-495d-9b3b-dfdc191216ab tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:50.751908 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5f81d380-2498-495d-9b3b-dfdc191216ab tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:50.752336 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5f81d380-2498-495d-9b3b-dfdc191216ab tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:50.758043 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-69f8a40c-7ef2-4036-b1df-5b10c5f2d56c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:50.765896 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-69f8a40c-7ef2-4036-b1df-5b10c5f2d56c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.163364 May 17 17:17:50.766153 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-5f81d380-2498-495d-9b3b-dfdc191216ab tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] HTTP exception thrown: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:17:50.766467 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 501/1034] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:50 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5f81d380-2498-495d-9b3b-dfdc191216ab tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Request method failure captured: May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 HTTP/1.1 May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9cGE5WwJ43H7c_jXMGhJwcMbrd3z2NY1pr03NfBNQtU1euQDxsTIEhWqMMVkzERF7Elr4_qRg9ROaXHF3Pel6Jv0boZYZaXVj_GbSpJlSTAM80tyqrlX3r9a2AmsKSuKxSITU8QmnJxzKhawMrmD-LwE6JBOutaQJxU6fBEvGobAW8 May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Openstack-Nova-Api-Version: 2.20 May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 9d587d1ef11b4055b77055e6fbcc1899 May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:17:50.767913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:17:50.769365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d587d1ef11b4055b77055e6fbcc1899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:50.769365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:50.769365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 9d587d1ef11b4055b77055e6fbcc1899 May 17 17:17:50.769365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1404132781 May 17 17:17:50.769365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-AttachVolumeShelveTestJSON-1404132781-project May 17 17:17:50.769365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:17:50.769365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:17:50.769365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 86a0b6c88fe84ba0907d515fd9f38e72 May 17 17:17:50.769365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1404132781-project May 17 17:17:50.769365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:17:50.769365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:17:50.769365 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': 'b074c961-149b-4667-addc-790568769b88'} May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:50.770328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b074c961-149b-4667-addc-790568769b88 could not be found. May 17 17:17:50.772748 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:50.774205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5f81d380-2498-495d-9b3b-dfdc191216ab tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] Returning 404 to user: Instance b074c961-149b-4667-addc-790568769b88 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:50.774205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5f81d380-2498-495d-9b3b-dfdc191216ab tempest-AttachVolumeShelveTestJSON-1404132781 tempest-AttachVolumeShelveTestJSON-1404132781-project] 10.222.0.48 "GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88" status: 404 len: 111 microversion: 2.20 time: 0.029435 May 17 17:17:50.774205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 534/1035] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 17 17:17:50 2022] GET /compute/v2.1/servers/b074c961-149b-4667-addc-790568769b88 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 17:17:50.920421 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-dfe8cfe4-9245-4ee3-a1ef-d1813191aac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:50.921010 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-dfe8cfe4-9245-4ee3-a1ef-d1813191aac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:50.926815 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dfe8cfe4-9245-4ee3-a1ef-d1813191aac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:50.927274 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dfe8cfe4-9245-4ee3-a1ef-d1813191aac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:50.928085 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dfe8cfe4-9245-4ee3-a1ef-d1813191aac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:50.928525 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dfe8cfe4-9245-4ee3-a1ef-d1813191aac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:51.149533 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-dfe8cfe4-9245-4ee3-a1ef-d1813191aac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:51.160031 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-dfe8cfe4-9245-4ee3-a1ef-d1813191aac7 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1680 microversion: 2.1 time: 0.243479 May 17 17:17:51.160924 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 502/1036] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:50 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:51.784564 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-22b55bf8-7978-4ccd-b480-86286b953964 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:51.788239 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-22b55bf8-7978-4ccd-b480-86286b953964 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:51.796446 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-22b55bf8-7978-4ccd-b480-86286b953964 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:51.796980 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-22b55bf8-7978-4ccd-b480-86286b953964 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:51.797863 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-22b55bf8-7978-4ccd-b480-86286b953964 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:51.798546 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-22b55bf8-7978-4ccd-b480-86286b953964 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:52.004916 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-22b55bf8-7978-4ccd-b480-86286b953964 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:52.021794 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-22b55bf8-7978-4ccd-b480-86286b953964 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.234700 May 17 17:17:52.032047 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 535/1037] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:51 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:52.106653 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-7c8612d1-3629-47af-a778-f332aca9523b req-f1a6fcad-d7c2-480f-9c8c-d938845c7a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82812c49-fa86-43cc-ab6f-2df6bf74dfd8", "tag": "69a028cd-6a7e-49ed-93d6-e5229bb69b2c"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:17:52.116498 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-7c8612d1-3629-47af-a778-f332aca9523b req-f1a6fcad-d7c2-480f-9c8c-d938845c7a5c service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:52.117181 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-7c8612d1-3629-47af-a778-f332aca9523b req-f1a6fcad-d7c2-480f-9c8c-d938845c7a5c service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:52.130239 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-7c8612d1-3629-47af-a778-f332aca9523b req-f1a6fcad-d7c2-480f-9c8c-d938845c7a5c service nova] Creating event network-changed:69a028cd-6a7e-49ed-93d6-e5229bb69b2c for instance 82812c49-fa86-43cc-ab6f-2df6bf74dfd8 on hv-cinder-84214 May 17 17:17:52.136165 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-7c8612d1-3629-47af-a778-f332aca9523b req-f1a6fcad-d7c2-480f-9c8c-d938845c7a5c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033318 May 17 17:17:52.137166 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 503/1038] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:52.179709 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8a7fc1da-3650-475b-9a73-055ef5625c1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:52.180323 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8a7fc1da-3650-475b-9a73-055ef5625c1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:52.186430 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8a7fc1da-3650-475b-9a73-055ef5625c1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:52.187118 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8a7fc1da-3650-475b-9a73-055ef5625c1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:52.188117 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8a7fc1da-3650-475b-9a73-055ef5625c1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:52.188704 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8a7fc1da-3650-475b-9a73-055ef5625c1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:52.377318 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8a7fc1da-3650-475b-9a73-055ef5625c1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:52.387554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8a7fc1da-3650-475b-9a73-055ef5625c1d tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1680 microversion: 2.1 time: 0.213076 May 17 17:17:52.388883 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 536/1039] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:52 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1680 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:53.041932 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-9776d035-fdcc-439a-a59d-a80e56db7da0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:53.042651 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-9776d035-fdcc-439a-a59d-a80e56db7da0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:53.059961 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9776d035-fdcc-439a-a59d-a80e56db7da0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:53.064044 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9776d035-fdcc-439a-a59d-a80e56db7da0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:53.064947 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9776d035-fdcc-439a-a59d-a80e56db7da0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:53.065505 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-9776d035-fdcc-439a-a59d-a80e56db7da0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:53.406054 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-18df1056-d9ec-4598-8107-b557459ab200 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:53.406778 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-18df1056-d9ec-4598-8107-b557459ab200 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:53.419471 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-18df1056-d9ec-4598-8107-b557459ab200 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:53.420328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-18df1056-d9ec-4598-8107-b557459ab200 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:53.433956 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-18df1056-d9ec-4598-8107-b557459ab200 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:53.434498 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-18df1056-d9ec-4598-8107-b557459ab200 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:53.504559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-18df1056-d9ec-4598-8107-b557459ab200 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:53.505278 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-18df1056-d9ec-4598-8107-b557459ab200 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:53.506487 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-18df1056-d9ec-4598-8107-b557459ab200 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lazy-loading 'fault' on Instance uuid b233a28b-810a-4304-a7cb-93b1c24f76fe {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:17:53.573155 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-18df1056-d9ec-4598-8107-b557459ab200 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61daaf70d25c4e1592fcb2f4feafff86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54981d1c7fe64f5cb6a846496ad4f776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:53.580057 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-9776d035-fdcc-439a-a59d-a80e56db7da0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:53.587207 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-9776d035-fdcc-439a-a59d-a80e56db7da0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.550191 May 17 17:17:53.590085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-18df1056-d9ec-4598-8107-b557459ab200 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 200 len: 1330 microversion: 2.1 time: 0.188133 May 17 17:17:53.591219 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 537/1040] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:53 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 1330 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:17:53.592515 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 504/1041] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:53 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:54.159880 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-545c16cd-3faf-4f62-bacb-bcf0775407b9 req-c0b07884-933e-4297-8771-e5742aee1929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b233a28b-810a-4304-a7cb-93b1c24f76fe", "name": "network-vif-deleted", "tag": "791f659d-31d5-4dc2-b5c3-e9c1d9bd7f25"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:17:54.168636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-545c16cd-3faf-4f62-bacb-bcf0775407b9 req-c0b07884-933e-4297-8771-e5742aee1929 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:54.169079 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-545c16cd-3faf-4f62-bacb-bcf0775407b9 req-c0b07884-933e-4297-8771-e5742aee1929 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:54.180361 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-545c16cd-3faf-4f62-bacb-bcf0775407b9 req-c0b07884-933e-4297-8771-e5742aee1929 service nova] Creating event network-vif-deleted:791f659d-31d5-4dc2-b5c3-e9c1d9bd7f25 for instance b233a28b-810a-4304-a7cb-93b1c24f76fe on hv-cinder-84214 May 17 17:17:54.187310 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-545c16cd-3faf-4f62-bacb-bcf0775407b9 req-c0b07884-933e-4297-8771-e5742aee1929 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030904 May 17 17:17:54.188577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 538/1042] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:54.611853 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3ed26bee-b3e1-4358-89a5-448054d8ef72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:54.612551 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-3ed26bee-b3e1-4358-89a5-448054d8ef72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:54.616868 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f963b584-79ab-4cdd-a435-458a24a61846 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:54.617484 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-f963b584-79ab-4cdd-a435-458a24a61846 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:54.626256 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f963b584-79ab-4cdd-a435-458a24a61846 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:54.626584 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3ed26bee-b3e1-4358-89a5-448054d8ef72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:54.626737 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f963b584-79ab-4cdd-a435-458a24a61846 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:54.627538 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3ed26bee-b3e1-4358-89a5-448054d8ef72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:54.628087 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f963b584-79ab-4cdd-a435-458a24a61846 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:54.628581 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3ed26bee-b3e1-4358-89a5-448054d8ef72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:54.628754 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-f963b584-79ab-4cdd-a435-458a24a61846 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:54.629355 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3ed26bee-b3e1-4358-89a5-448054d8ef72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:54.650097 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-f963b584-79ab-4cdd-a435-458a24a61846 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] HTTP exception thrown: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f963b584-79ab-4cdd-a435-458a24a61846 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Request method failure captured: May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe HTTP/1.1 May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9dPWJVb7qwYBnOyu2SibnIHb7br9I07PYlwLrrT_SRrqmmG-Yk2L4b9g7-opL8KlEa-VvVIvtF7WR6pTkYQoWCb_iUMaherr4GYvkZBEx7i_4xoMizUYe3fXvOKjqnKrfi4cSl1B6_TYNoX5UI1IzkedqJD3SKAMFqJ-H9rW400QlM May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:17:54.653437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:17:54.655448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:54.655448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:54.655448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:54.655448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:54.655448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:54.655448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:17:54.655448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:17:54.655448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 61daaf70d25c4e1592fcb2f4feafff86 May 17 17:17:54.655448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:54.655448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:17:54.655448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:54.655448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': 'b233a28b-810a-4304-a7cb-93b1c24f76fe'} May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:54.656448 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:54.657715 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:54.660476 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-f963b584-79ab-4cdd-a435-458a24a61846 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Returning 404 to user: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:54.661433 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-f963b584-79ab-4cdd-a435-458a24a61846 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 404 len: 111 microversion: 2.1 time: 0.057804 May 17 17:17:54.662396 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 505/1043] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:54 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:17:54.676712 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-234504f2-8da4-42ff-8f2d-deb352847c07 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '.version_select at 0x7feb1ca5a160>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:54.700175 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-234504f2-8da4-42ff-8f2d-deb352847c07 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-447927977" status: 202 len: 0 microversion: 2.1 time: 0.032544 May 17 17:17:54.700750 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 506/1044] 10.222.0.48 () {58 vars in 1217 bytes} [Tue May 17 17:17:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-447927977 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:17:54.833886 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-3ed26bee-b3e1-4358-89a5-448054d8ef72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:54.846507 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-3ed26bee-b3e1-4358-89a5-448054d8ef72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.238965 May 17 17:17:54.848058 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 539/1045] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:54 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:55.311310 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-128baa34-4ad2-4ed2-977f-27fe7867b319 req-c005c420-7c80-4c29-ac0c-870aebce8a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa95d7a-9071-46b7-bff5-c6d3fa54d1d3", "name": "network-vif-plugged", "status": "completed", "tag": "71199a70-f362-4ec1-8023-8d7cd045f666"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:17:55.319446 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-128baa34-4ad2-4ed2-977f-27fe7867b319 req-c005c420-7c80-4c29-ac0c-870aebce8a29 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:55.320211 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-128baa34-4ad2-4ed2-977f-27fe7867b319 req-c005c420-7c80-4c29-ac0c-870aebce8a29 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:55.334382 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-128baa34-4ad2-4ed2-977f-27fe7867b319 req-c005c420-7c80-4c29-ac0c-870aebce8a29 service nova] Creating event network-vif-plugged:71199a70-f362-4ec1-8023-8d7cd045f666 for instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 on hv-cinder-84214 May 17 17:17:55.340060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-128baa34-4ad2-4ed2-977f-27fe7867b319 req-c005c420-7c80-4c29-ac0c-870aebce8a29 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032523 May 17 17:17:55.341289 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 507/1046] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:55.864516 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-31f2f15e-133f-4050-b5d5-b1fbd209ce5c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:55.865226 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-31f2f15e-133f-4050-b5d5-b1fbd209ce5c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:55.876248 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-31f2f15e-133f-4050-b5d5-b1fbd209ce5c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:55.876699 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-31f2f15e-133f-4050-b5d5-b1fbd209ce5c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:55.877480 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-31f2f15e-133f-4050-b5d5-b1fbd209ce5c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:55.877919 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-31f2f15e-133f-4050-b5d5-b1fbd209ce5c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:56.034522 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-31f2f15e-133f-4050-b5d5-b1fbd209ce5c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:56.042704 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-31f2f15e-133f-4050-b5d5-b1fbd209ce5c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.182176 May 17 17:17:56.057351 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 540/1047] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:55 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:56.799168 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-acd728dd-012d-42af-b51e-3e3f695a18a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:56.799794 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-acd728dd-012d-42af-b51e-3e3f695a18a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:56.808221 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-acd728dd-012d-42af-b51e-3e3f695a18a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:56.808672 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-acd728dd-012d-42af-b51e-3e3f695a18a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:56.809620 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-acd728dd-012d-42af-b51e-3e3f695a18a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:56.810061 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-acd728dd-012d-42af-b51e-3e3f695a18a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:56.825080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-acd728dd-012d-42af-b51e-3e3f695a18a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] HTTP exception thrown: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-acd728dd-012d-42af-b51e-3e3f695a18a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Request method failure captured: May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: DELETE /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe HTTP/1.1 May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9dPWJVb7qwYBnOyu2SibnIHb7br9I07PYlwLrrT_SRrqmmG-Yk2L4b9g7-opL8KlEa-VvVIvtF7WR6pTkYQoWCb_iUMaherr4GYvkZBEx7i_4xoMizUYe3fXvOKjqnKrfi4cSl1B6_TYNoX5UI1IzkedqJD3SKAMFqJ-H9rW400QlM May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:17:56.826758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:17:56.828495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:56.828495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:56.828495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:56.828495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:56.828495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:56.828495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:17:56.828495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:17:56.828495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 61daaf70d25c4e1592fcb2f4feafff86 May 17 17:17:56.828495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:56.828495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:17:56.828495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:56.828495 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': 'b233a28b-810a-4304-a7cb-93b1c24f76fe'} May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:56.832666 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:56.834386 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:56.835911 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-acd728dd-012d-42af-b51e-3e3f695a18a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Returning 404 to user: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:56.835911 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-acd728dd-012d-42af-b51e-3e3f695a18a3 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 404 len: 111 microversion: 2.1 time: 0.033686 May 17 17:17:56.835911 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 508/1048] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:17:56 2022] DELETE /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:17:56.837324 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9ef31513-4e1b-4daf-880d-fb170fe6399f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:56.838178 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-9ef31513-4e1b-4daf-880d-fb170fe6399f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: b233a28b-810a-4304-a7cb-93b1c24f76fe] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:56.845426 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9ef31513-4e1b-4daf-880d-fb170fe6399f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:56.845875 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9ef31513-4e1b-4daf-880d-fb170fe6399f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:56.846642 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9ef31513-4e1b-4daf-880d-fb170fe6399f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:56.847061 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-9ef31513-4e1b-4daf-880d-fb170fe6399f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:56.861905 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-9ef31513-4e1b-4daf-880d-fb170fe6399f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] HTTP exception thrown: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9ef31513-4e1b-4daf-880d-fb170fe6399f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Request method failure captured: May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe HTTP/1.1 May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9dPWJVb7qwYBnOyu2SibnIHb7br9I07PYlwLrrT_SRrqmmG-Yk2L4b9g7-opL8KlEa-VvVIvtF7WR6pTkYQoWCb_iUMaherr4GYvkZBEx7i_4xoMizUYe3fXvOKjqnKrfi4cSl1B6_TYNoX5UI1IzkedqJD3SKAMFqJ-H9rW400QlM May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:17:56.863780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:17:56.865585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:56.865585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:56.865585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:56.865585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:56.865585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:56.865585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:17:56.865585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:17:56.865585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 61daaf70d25c4e1592fcb2f4feafff86 May 17 17:17:56.865585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:56.865585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:17:56.865585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:56.865585 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': 'b233a28b-810a-4304-a7cb-93b1c24f76fe'} May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:56.870500 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. May 17 17:17:56.871846 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:56.872957 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-9ef31513-4e1b-4daf-880d-fb170fe6399f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Returning 404 to user: Instance b233a28b-810a-4304-a7cb-93b1c24f76fe could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:56.872957 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-9ef31513-4e1b-4daf-880d-fb170fe6399f tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe" status: 404 len: 111 microversion: 2.1 time: 0.031853 May 17 17:17:56.872957 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 541/1049] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:56 2022] GET /compute/v2.1/servers/b233a28b-810a-4304-a7cb-93b1c24f76fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:17:57.059904 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1db6efdc-9067-4acb-b82e-33db665658e0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:57.060766 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1db6efdc-9067-4acb-b82e-33db665658e0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:57.067686 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1db6efdc-9067-4acb-b82e-33db665658e0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:57.068323 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1db6efdc-9067-4acb-b82e-33db665658e0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:57.069253 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1db6efdc-9067-4acb-b82e-33db665658e0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:57.069849 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1db6efdc-9067-4acb-b82e-33db665658e0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:57.254283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1db6efdc-9067-4acb-b82e-33db665658e0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:57.264035 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1db6efdc-9067-4acb-b82e-33db665658e0 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1359 microversion: 2.1 time: 0.208812 May 17 17:17:57.264768 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 509/1050] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:57 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:58.042582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-10e88293-5ee2-4b54-ad57-83efc3519712 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:58.043160 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-10e88293-5ee2-4b54-ad57-83efc3519712 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:58.049389 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-10e88293-5ee2-4b54-ad57-83efc3519712 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.049910 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-10e88293-5ee2-4b54-ad57-83efc3519712 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.050672 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-10e88293-5ee2-4b54-ad57-83efc3519712 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.051100 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-10e88293-5ee2-4b54-ad57-83efc3519712 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.064914 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-10e88293-5ee2-4b54-ad57-83efc3519712 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] HTTP exception thrown: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-10e88293-5ee2-4b54-ad57-83efc3519712 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Request method failure captured: May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: DELETE /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f HTTP/1.1 May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9dPWJVb7qwYBnOyu2SibnIHb7br9I07PYlwLrrT_SRrqmmG-Yk2L4b9g7-opL8KlEa-VvVIvtF7WR6pTkYQoWCb_iUMaherr4GYvkZBEx7i_4xoMizUYe3fXvOKjqnKrfi4cSl1B6_TYNoX5UI1IzkedqJD3SKAMFqJ-H9rW400QlM May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:17:58.066515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:17:58.068128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:58.068128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:58.068128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:58.068128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:58.068128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:58.068128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:17:58.068128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:17:58.068128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 61daaf70d25c4e1592fcb2f4feafff86 May 17 17:17:58.068128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:58.068128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:17:58.068128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:17:58.068128 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': 'c3d54d34-bc48-4fdd-8665-f9403cbb8c8f'} May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:58.069042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:17:58.070554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:58.075342 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-10e88293-5ee2-4b54-ad57-83efc3519712 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Returning 404 to user: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:58.075342 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-10e88293-5ee2-4b54-ad57-83efc3519712 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 404 len: 111 microversion: 2.1 time: 0.031185 May 17 17:17:58.075342 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 542/1051] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:17:58 2022] DELETE /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:17:58.080738 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-75cd40b7-ecb8-4365-a859-bfc593923d8a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:58.081367 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-75cd40b7-ecb8-4365-a859-bfc593923d8a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: c3d54d34-bc48-4fdd-8665-f9403cbb8c8f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:58.090826 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-75cd40b7-ecb8-4365-a859-bfc593923d8a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.091456 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-75cd40b7-ecb8-4365-a859-bfc593923d8a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.092665 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-75cd40b7-ecb8-4365-a859-bfc593923d8a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.093218 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-75cd40b7-ecb8-4365-a859-bfc593923d8a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.109289 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-75cd40b7-ecb8-4365-a859-bfc593923d8a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] HTTP exception thrown: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-75cd40b7-ecb8-4365-a859-bfc593923d8a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Request method failure captured: May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f HTTP/1.1 May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9dPWJVb7qwYBnOyu2SibnIHb7br9I07PYlwLrrT_SRrqmmG-Yk2L4b9g7-opL8KlEa-VvVIvtF7WR6pTkYQoWCb_iUMaherr4GYvkZBEx7i_4xoMizUYe3fXvOKjqnKrfi4cSl1B6_TYNoX5UI1IzkedqJD3SKAMFqJ-H9rW400QlM May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:17:58.110892 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:17:58.112509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:58.112509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:58.112509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:58.112509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:58.112509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:58.112509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:17:58.112509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:17:58.112509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 61daaf70d25c4e1592fcb2f4feafff86 May 17 17:17:58.112509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:58.112509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:17:58.112509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:17:58.112509 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': 'c3d54d34-bc48-4fdd-8665-f9403cbb8c8f'} May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:58.113312 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. May 17 17:17:58.114564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:58.115769 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-75cd40b7-ecb8-4365-a859-bfc593923d8a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Returning 404 to user: Instance c3d54d34-bc48-4fdd-8665-f9403cbb8c8f could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:58.115769 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-75cd40b7-ecb8-4365-a859-bfc593923d8a tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f" status: 404 len: 111 microversion: 2.1 time: 0.035614 May 17 17:17:58.115769 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 510/1052] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:58 2022] GET /compute/v2.1/servers/c3d54d34-bc48-4fdd-8665-f9403cbb8c8f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:17:58.120995 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-921ecfdd-6a05-48e3-9955-2a1d9f9a5278 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:58.121496 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-921ecfdd-6a05-48e3-9955-2a1d9f9a5278 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:58.127490 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-921ecfdd-6a05-48e3-9955-2a1d9f9a5278 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.128386 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-921ecfdd-6a05-48e3-9955-2a1d9f9a5278 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.129163 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-921ecfdd-6a05-48e3-9955-2a1d9f9a5278 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.129601 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-921ecfdd-6a05-48e3-9955-2a1d9f9a5278 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.143912 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-921ecfdd-6a05-48e3-9955-2a1d9f9a5278 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] HTTP exception thrown: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-921ecfdd-6a05-48e3-9955-2a1d9f9a5278 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Request method failure captured: May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: DELETE /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 HTTP/1.1 May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9dPWJVb7qwYBnOyu2SibnIHb7br9I07PYlwLrrT_SRrqmmG-Yk2L4b9g7-opL8KlEa-VvVIvtF7WR6pTkYQoWCb_iUMaherr4GYvkZBEx7i_4xoMizUYe3fXvOKjqnKrfi4cSl1B6_TYNoX5UI1IzkedqJD3SKAMFqJ-H9rW400QlM May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:17:58.145438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:17:58.146809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:58.146809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:58.146809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:58.146809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:58.146809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:58.146809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:17:58.146809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:17:58.146809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 61daaf70d25c4e1592fcb2f4feafff86 May 17 17:17:58.146809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:58.146809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:17:58.146809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:17:58.146809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': 'cb476330-5832-4b1c-bc73-9e902cbb77b2'} May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:58.147593 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:17:58.149282 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:58.151285 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-921ecfdd-6a05-48e3-9955-2a1d9f9a5278 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Returning 404 to user: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:58.151285 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-921ecfdd-6a05-48e3-9955-2a1d9f9a5278 tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 404 len: 111 microversion: 2.1 time: 0.029969 May 17 17:17:58.151285 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 543/1053] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:17:58 2022] DELETE /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 17:17:58.156824 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-98a43046-c637-4ae7-a08b-34e89071a7ca tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:58.157437 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-98a43046-c637-4ae7-a08b-34e89071a7ca tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: cb476330-5832-4b1c-bc73-9e902cbb77b2] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:58.163427 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-98a43046-c637-4ae7-a08b-34e89071a7ca tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.163933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-98a43046-c637-4ae7-a08b-34e89071a7ca tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.164707 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-98a43046-c637-4ae7-a08b-34e89071a7ca tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.165148 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-98a43046-c637-4ae7-a08b-34e89071a7ca tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.179684 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-98a43046-c637-4ae7-a08b-34e89071a7ca tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] HTTP exception thrown: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-98a43046-c637-4ae7-a08b-34e89071a7ca tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Request method failure captured: May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 HTTP/1.1 May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9dPWJVb7qwYBnOyu2SibnIHb7br9I07PYlwLrrT_SRrqmmG-Yk2L4b9g7-opL8KlEa-VvVIvtF7WR6pTkYQoWCb_iUMaherr4GYvkZBEx7i_4xoMizUYe3fXvOKjqnKrfi4cSl1B6_TYNoX5UI1IzkedqJD3SKAMFqJ-H9rW400QlM May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:17:58.181463 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:17:58.183187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:58.183187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:58.183187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:58.183187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:58.183187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:58.183187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:17:58.183187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:17:58.183187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 61daaf70d25c4e1592fcb2f4feafff86 May 17 17:17:58.183187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:58.183187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:17:58.183187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:17:58.183187 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': 'cb476330-5832-4b1c-bc73-9e902cbb77b2'} May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:58.184288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. May 17 17:17:58.186494 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:58.188916 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-98a43046-c637-4ae7-a08b-34e89071a7ca tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Returning 404 to user: Instance cb476330-5832-4b1c-bc73-9e902cbb77b2 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:58.189792 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-98a43046-c637-4ae7-a08b-34e89071a7ca tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2" status: 404 len: 111 microversion: 2.1 time: 0.037295 May 17 17:17:58.190357 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 511/1054] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:58 2022] GET /compute/v2.1/servers/cb476330-5832-4b1c-bc73-9e902cbb77b2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:17:58.282425 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a8f7e2f4-52ec-4a76-8f01-995b7a07a367 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:58.283040 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a8f7e2f4-52ec-4a76-8f01-995b7a07a367 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:58.289413 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8f7e2f4-52ec-4a76-8f01-995b7a07a367 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.290138 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8f7e2f4-52ec-4a76-8f01-995b7a07a367 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.292729 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8f7e2f4-52ec-4a76-8f01-995b7a07a367 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.293632 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a8f7e2f4-52ec-4a76-8f01-995b7a07a367 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.483016 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a8f7e2f4-52ec-4a76-8f01-995b7a07a367 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:58.491246 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a8f7e2f4-52ec-4a76-8f01-995b7a07a367 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1548 microversion: 2.1 time: 0.212770 May 17 17:17:58.492279 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 544/1055] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:58 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1548 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:58.507842 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d9b13e9f-fa08-4f8a-ba2d-ddda2eafb2a3 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:58.508822 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d9b13e9f-fa08-4f8a-ba2d-ddda2eafb2a3 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:58.515242 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d9b13e9f-fa08-4f8a-ba2d-ddda2eafb2a3 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.515635 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d9b13e9f-fa08-4f8a-ba2d-ddda2eafb2a3 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.517124 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d9b13e9f-fa08-4f8a-ba2d-ddda2eafb2a3 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.517529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d9b13e9f-fa08-4f8a-ba2d-ddda2eafb2a3 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.666909 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d9b13e9f-fa08-4f8a-ba2d-ddda2eafb2a3 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:58.675033 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d9b13e9f-fa08-4f8a-ba2d-ddda2eafb2a3 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1548 microversion: 2.1 time: 0.170930 May 17 17:17:58.683502 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 512/1056] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:58 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:58.691188 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-11e5192c-53c9-4ffe-a2fc-61426287b659 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:58.695113 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-11e5192c-53c9-4ffe-a2fc-61426287b659 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:58.696093 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-11e5192c-53c9-4ffe-a2fc-61426287b659 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Searching by: {'deleted': False, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3'} {{(pid=117090) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 17 17:17:58.703350 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-11e5192c-53c9-4ffe-a2fc-61426287b659 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.703840 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-11e5192c-53c9-4ffe-a2fc-61426287b659 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.704623 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-11e5192c-53c9-4ffe-a2fc-61426287b659 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.705250 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-11e5192c-53c9-4ffe-a2fc-61426287b659 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.800719 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.multi_cell_list [None req-11e5192c-53c9-4ffe-a2fc-61426287b659 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117090) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 17 17:17:58.900237 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-11e5192c-53c9-4ffe-a2fc-61426287b659 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212061 May 17 17:17:58.901711 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 545/1057] 10.222.0.48 () {58 vars in 1124 bytes} [Tue May 17 17:17:58 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:17:58.912237 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-637082b0-3779-470a-bf56-4aabf10ddf18 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:58.912849 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-637082b0-3779-470a-bf56-4aabf10ddf18 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:58.919937 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-637082b0-3779-470a-bf56-4aabf10ddf18 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.920350 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-637082b0-3779-470a-bf56-4aabf10ddf18 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:58.921117 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-637082b0-3779-470a-bf56-4aabf10ddf18 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:58.921832 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-637082b0-3779-470a-bf56-4aabf10ddf18 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:59.057253 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-637082b0-3779-470a-bf56-4aabf10ddf18 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:17:59.065329 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-637082b0-3779-470a-bf56-4aabf10ddf18 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1548 microversion: 2.1 time: 0.156397 May 17 17:17:59.079760 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 513/1058] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:58 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:17:59.358428 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f6128fcf-48d0-4a64-b3d3-63bdb9dfaaac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:59.359547 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-f6128fcf-48d0-4a64-b3d3-63bdb9dfaaac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:59.367117 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f6128fcf-48d0-4a64-b3d3-63bdb9dfaaac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:59.367573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f6128fcf-48d0-4a64-b3d3-63bdb9dfaaac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:59.369181 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f6128fcf-48d0-4a64-b3d3-63bdb9dfaaac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:59.370815 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-f6128fcf-48d0-4a64-b3d3-63bdb9dfaaac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:59.385714 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-f6128fcf-48d0-4a64-b3d3-63bdb9dfaaac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] HTTP exception thrown: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f6128fcf-48d0-4a64-b3d3-63bdb9dfaaac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Request method failure captured: May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: DELETE /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 HTTP/1.1 May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9dPWJVb7qwYBnOyu2SibnIHb7br9I07PYlwLrrT_SRrqmmG-Yk2L4b9g7-opL8KlEa-VvVIvtF7WR6pTkYQoWCb_iUMaherr4GYvkZBEx7i_4xoMizUYe3fXvOKjqnKrfi4cSl1B6_TYNoX5UI1IzkedqJD3SKAMFqJ-H9rW400QlM May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:17:59.387273 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:17:59.389761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:59.389761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:59.389761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:59.389761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:59.389761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:59.389761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:17:59.389761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:17:59.389761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 61daaf70d25c4e1592fcb2f4feafff86 May 17 17:17:59.389761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:59.389761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:17:59.389761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:17:59.389761 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '0a762b56-1a2c-4556-90cb-52de211c17a5'} May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:59.390636 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:17:59.392036 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:17:59.393969 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-f6128fcf-48d0-4a64-b3d3-63bdb9dfaaac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Returning 404 to user: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:59.393969 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-f6128fcf-48d0-4a64-b3d3-63bdb9dfaaac tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 404 len: 111 microversion: 2.1 time: 0.034335 May 17 17:17:59.393969 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 546/1059] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:17:59 2022] DELETE /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:17:59.399652 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-80635a26-8861-4da1-8322-b1e283f9bded tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:17:59.400899 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-80635a26-8861-4da1-8322-b1e283f9bded tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] [instance: 0a762b56-1a2c-4556-90cb-52de211c17a5] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:17:59.407378 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80635a26-8861-4da1-8322-b1e283f9bded tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:59.407878 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80635a26-8861-4da1-8322-b1e283f9bded tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:59.408663 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80635a26-8861-4da1-8322-b1e283f9bded tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:17:59.409107 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-80635a26-8861-4da1-8322-b1e283f9bded tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:17:59.423167 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-80635a26-8861-4da1-8322-b1e283f9bded tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] HTTP exception thrown: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-80635a26-8861-4da1-8322-b1e283f9bded tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Request method failure captured: May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 HTTP/1.1 May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9dPWJVb7qwYBnOyu2SibnIHb7br9I07PYlwLrrT_SRrqmmG-Yk2L4b9g7-opL8KlEa-VvVIvtF7WR6pTkYQoWCb_iUMaherr4GYvkZBEx7i_4xoMizUYe3fXvOKjqnKrfi4cSl1B6_TYNoX5UI1IzkedqJD3SKAMFqJ-H9rW400QlM May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:17:59.424751 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:17:59.426364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54981d1c7fe64f5cb6a846496ad4f776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:17:59.426364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:59.426364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 54981d1c7fe64f5cb6a846496ad4f776 May 17 17:17:59.426364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1444210020 May 17 17:17:59.426364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:59.426364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:17:59.426364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:17:59.426364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 61daaf70d25c4e1592fcb2f4feafff86 May 17 17:17:59.426364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-AttachVolumeNegativeTest-1444210020-project May 17 17:17:59.426364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:17:59.426364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:17:59.426364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': '0a762b56-1a2c-4556-90cb-52de211c17a5'} May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:17:59.428344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. May 17 17:17:59.429933 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:17:59.431486 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-80635a26-8861-4da1-8322-b1e283f9bded tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] Returning 404 to user: Instance 0a762b56-1a2c-4556-90cb-52de211c17a5 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:17:59.431486 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-80635a26-8861-4da1-8322-b1e283f9bded tempest-AttachVolumeNegativeTest-1444210020 tempest-AttachVolumeNegativeTest-1444210020-project] 10.222.0.48 "GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5" status: 404 len: 111 microversion: 2.1 time: 0.030827 May 17 17:17:59.431486 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 514/1060] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:17:59 2022] GET /compute/v2.1/servers/0a762b56-1a2c-4556-90cb-52de211c17a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:18:00.689356 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-60b0df2f-79df-450e-ae7a-d15b53cfa639 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e20086a-8518-4367-a78a-e19dcc74b583"}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:18:00.691051 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-60b0df2f-79df-450e-ae7a-d15b53cfa639 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:00.698811 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-60b0df2f-79df-450e-ae7a-d15b53cfa639 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:00.699700 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-60b0df2f-79df-450e-ae7a-d15b53cfa639 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:00.700588 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-60b0df2f-79df-450e-ae7a-d15b53cfa639 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:00.701098 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-60b0df2f-79df-450e-ae7a-d15b53cfa639 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:01.051657 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-60b0df2f-79df-450e-ae7a-d15b53cfa639 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "POST /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365827 May 17 17:18:01.052404 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 547/1061] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 17 17:18:00 2022] POST /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:18:08.738679 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a13b6a09-35b6-472d-81b7-65a76971d333 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:08.739207 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a13b6a09-35b6-472d-81b7-65a76971d333 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:08.746927 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a13b6a09-35b6-472d-81b7-65a76971d333 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:08.747389 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a13b6a09-35b6-472d-81b7-65a76971d333 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:08.748355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a13b6a09-35b6-472d-81b7-65a76971d333 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:08.748842 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a13b6a09-35b6-472d-81b7-65a76971d333 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:08.890816 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a13b6a09-35b6-472d-81b7-65a76971d333 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:08.911059 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a13b6a09-35b6-472d-81b7-65a76971d333 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1594 microversion: 2.1 time: 0.174255 May 17 17:18:08.911059 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 515/1062] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:08 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1594 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:11.123952 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-47f516b0-7571-40a9-a3cf-63333eb386e1 req-c8296efc-40d9-49d7-836f-5145f6a214b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa95d7a-9071-46b7-bff5-c6d3fa54d1d3", "tag": "71199a70-f362-4ec1-8023-8d7cd045f666"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:18:11.135584 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-47f516b0-7571-40a9-a3cf-63333eb386e1 req-c8296efc-40d9-49d7-836f-5145f6a214b4 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:11.136341 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-47f516b0-7571-40a9-a3cf-63333eb386e1 req-c8296efc-40d9-49d7-836f-5145f6a214b4 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:11.150411 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-47f516b0-7571-40a9-a3cf-63333eb386e1 req-c8296efc-40d9-49d7-836f-5145f6a214b4 service nova] Creating event network-changed:71199a70-f362-4ec1-8023-8d7cd045f666 for instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 on hv-cinder-84214 May 17 17:18:11.156423 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-47f516b0-7571-40a9-a3cf-63333eb386e1 req-c8296efc-40d9-49d7-836f-5145f6a214b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039692 May 17 17:18:11.157231 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 548/1063] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:18:12.522269 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-798073df-a1ea-490a-8498-b328d414374c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-878442003"}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:18:12.522919 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-798073df-a1ea-490a-8498-b328d414374c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:12.531192 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-798073df-a1ea-490a-8498-b328d414374c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:12.531780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-798073df-a1ea-490a-8498-b328d414374c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:12.532795 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-798073df-a1ea-490a-8498-b328d414374c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:12.534341 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-798073df-a1ea-490a-8498-b328d414374c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:12.700936 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.network.security_group_api [None req-798073df-a1ea-490a-8498-b328d414374c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Adding security group 5786b2ea-a989-4589-b327-0930d16c877f to port 71199a70-f362-4ec1-8023-8d7cd045f666 May 17 17:18:13.356265 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-798073df-a1ea-490a-8498-b328d414374c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "POST /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.837616 May 17 17:18:13.357217 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 516/1064] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 17 17:18:12 2022] POST /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/action => generated 0 bytes in 840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:18:13.374336 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-6673eaec-d675-4e06-b84a-5876212cb5e5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:13.375683 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-6673eaec-d675-4e06-b84a-5876212cb5e5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:13.377963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-c9e680c9-33d4-4be5-84f1-bcd0357fc032 req-17b387a7-8510-4877-98ff-536219d095c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa95d7a-9071-46b7-bff5-c6d3fa54d1d3", "tag": "71199a70-f362-4ec1-8023-8d7cd045f666"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:18:13.400538 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6673eaec-d675-4e06-b84a-5876212cb5e5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:13.401370 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-c9e680c9-33d4-4be5-84f1-bcd0357fc032 req-17b387a7-8510-4877-98ff-536219d095c8 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:13.401853 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-c9e680c9-33d4-4be5-84f1-bcd0357fc032 req-17b387a7-8510-4877-98ff-536219d095c8 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:13.403305 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6673eaec-d675-4e06-b84a-5876212cb5e5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:13.407745 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6673eaec-d675-4e06-b84a-5876212cb5e5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:13.407745 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-6673eaec-d675-4e06-b84a-5876212cb5e5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:13.427039 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-c9e680c9-33d4-4be5-84f1-bcd0357fc032 req-17b387a7-8510-4877-98ff-536219d095c8 service nova] Creating event network-changed:71199a70-f362-4ec1-8023-8d7cd045f666 for instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 on hv-cinder-84214 May 17 17:18:13.439288 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-c9e680c9-33d4-4be5-84f1-bcd0357fc032 req-17b387a7-8510-4877-98ff-536219d095c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071887 May 17 17:18:13.439789 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 517/1065] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:18:13.981474 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-6673eaec-d675-4e06-b84a-5876212cb5e5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:14.003870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-6673eaec-d675-4e06-b84a-5876212cb5e5 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1759 microversion: 2.1 time: 0.641954 May 17 17:18:14.016265 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 549/1066] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:13 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1759 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:14.498344 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d60155ae-a93c-4381-9e28-c4bc018eec1e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:14.499640 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d60155ae-a93c-4381-9e28-c4bc018eec1e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:14.505917 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d60155ae-a93c-4381-9e28-c4bc018eec1e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:14.506376 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d60155ae-a93c-4381-9e28-c4bc018eec1e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:14.507145 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d60155ae-a93c-4381-9e28-c4bc018eec1e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:14.507914 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d60155ae-a93c-4381-9e28-c4bc018eec1e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:14.534175 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d60155ae-a93c-4381-9e28-c4bc018eec1e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Going to try to terminate instance {{(pid=117089) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:18:14.630117 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d60155ae-a93c-4381-9e28-c4bc018eec1e tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "DELETE /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 204 len: 0 microversion: 2.1 time: 0.140849 May 17 17:18:14.635874 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 518/1067] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:18:14 2022] DELETE /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:18:14.642967 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2f965f18-53a6-40b9-be97-7c908808dde4 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:14.643764 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2f965f18-53a6-40b9-be97-7c908808dde4 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:14.650898 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2f965f18-53a6-40b9-be97-7c908808dde4 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:14.651576 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2f965f18-53a6-40b9-be97-7c908808dde4 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:14.652384 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2f965f18-53a6-40b9-be97-7c908808dde4 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:14.652816 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2f965f18-53a6-40b9-be97-7c908808dde4 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:14.811139 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-2f965f18-53a6-40b9-be97-7c908808dde4 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:14.821890 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2f965f18-53a6-40b9-be97-7c908808dde4 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.185339 May 17 17:18:14.822957 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 550/1068] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:14 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:15.467315 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-dc7e743c-5ca9-47f7-a934-73d480f7d96a req-0e453c2b-f310-4c2d-bf71-ba5858804833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47d1426b-07f8-410e-b753-b1d8e9c1102f", "tag": "72213c8f-95d2-4e6b-bc71-ec5cf8e62273"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:18:15.475765 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-dc7e743c-5ca9-47f7-a934-73d480f7d96a req-0e453c2b-f310-4c2d-bf71-ba5858804833 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:15.476222 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-dc7e743c-5ca9-47f7-a934-73d480f7d96a req-0e453c2b-f310-4c2d-bf71-ba5858804833 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:15.487945 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-dc7e743c-5ca9-47f7-a934-73d480f7d96a req-0e453c2b-f310-4c2d-bf71-ba5858804833 service nova] Creating event network-changed:72213c8f-95d2-4e6b-bc71-ec5cf8e62273 for instance 47d1426b-07f8-410e-b753-b1d8e9c1102f on hv-cinder-84214 May 17 17:18:15.493747 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-dc7e743c-5ca9-47f7-a934-73d480f7d96a req-0e453c2b-f310-4c2d-bf71-ba5858804833 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030503 May 17 17:18:15.494289 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 519/1069] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:18:15.840977 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-ef88dcdf-a02d-440a-bd9c-5a177a75eaff tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:15.841582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-ef88dcdf-a02d-440a-bd9c-5a177a75eaff tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:15.847917 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ef88dcdf-a02d-440a-bd9c-5a177a75eaff tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:15.848360 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ef88dcdf-a02d-440a-bd9c-5a177a75eaff tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:15.849108 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ef88dcdf-a02d-440a-bd9c-5a177a75eaff tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:15.849538 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-ef88dcdf-a02d-440a-bd9c-5a177a75eaff tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:15.993712 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-ef88dcdf-a02d-440a-bd9c-5a177a75eaff tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:16.001765 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-ef88dcdf-a02d-440a-bd9c-5a177a75eaff tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1567 microversion: 2.1 time: 0.164526 May 17 17:18:16.002437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 551/1070] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:15 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:17.018930 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d48a4a72-02b0-4f42-aa3b-45e2a6d1a74d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:17.019669 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d48a4a72-02b0-4f42-aa3b-45e2a6d1a74d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:17.034556 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d48a4a72-02b0-4f42-aa3b-45e2a6d1a74d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:17.035020 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d48a4a72-02b0-4f42-aa3b-45e2a6d1a74d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:17.036079 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d48a4a72-02b0-4f42-aa3b-45e2a6d1a74d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:17.036696 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d48a4a72-02b0-4f42-aa3b-45e2a6d1a74d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:17.065821 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-ac2a26f2-33f5-4f6e-98c5-b0a075a1300c req-69e29e99-b45e-4749-9d1b-734118a5e935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d1426b-07f8-410e-b753-b1d8e9c1102f", "name": "network-vif-deleted", "tag": "72213c8f-95d2-4e6b-bc71-ec5cf8e62273"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:18:17.076202 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-ac2a26f2-33f5-4f6e-98c5-b0a075a1300c req-69e29e99-b45e-4749-9d1b-734118a5e935 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:17.076978 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-ac2a26f2-33f5-4f6e-98c5-b0a075a1300c req-69e29e99-b45e-4749-9d1b-734118a5e935 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:17.092345 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-ac2a26f2-33f5-4f6e-98c5-b0a075a1300c req-69e29e99-b45e-4749-9d1b-734118a5e935 service nova] Creating event network-vif-deleted:72213c8f-95d2-4e6b-bc71-ec5cf8e62273 for instance 47d1426b-07f8-410e-b753-b1d8e9c1102f on hv-cinder-84214 May 17 17:18:17.095886 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-ac2a26f2-33f5-4f6e-98c5-b0a075a1300c req-69e29e99-b45e-4749-9d1b-734118a5e935 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033573 May 17 17:18:17.096584 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 552/1071] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:18:17.115313 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d48a4a72-02b0-4f42-aa3b-45e2a6d1a74d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4302f72c503341d4a5367613edf38055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2630e0044e5f4f28b8d2adcfeaf0c604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:17.123893 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d48a4a72-02b0-4f42-aa3b-45e2a6d1a74d tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 200 len: 1381 microversion: 2.1 time: 0.109067 May 17 17:18:17.124471 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 520/1072] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:17 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 1381 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:18.141689 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-02f1cf6f-de43-471c-83fa-955def4b8488 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:18.142400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-02f1cf6f-de43-471c-83fa-955def4b8488 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] [instance: 47d1426b-07f8-410e-b753-b1d8e9c1102f] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:18.149137 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-02f1cf6f-de43-471c-83fa-955def4b8488 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:18.149611 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-02f1cf6f-de43-471c-83fa-955def4b8488 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:18.150620 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-02f1cf6f-de43-471c-83fa-955def4b8488 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:18.151050 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-02f1cf6f-de43-471c-83fa-955def4b8488 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:18.164195 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-02f1cf6f-de43-471c-83fa-955def4b8488 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] HTTP exception thrown: Instance 47d1426b-07f8-410e-b753-b1d8e9c1102f could not be found. May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-02f1cf6f-de43-471c-83fa-955def4b8488 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Request method failure captured: May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f HTTP/1.1 May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9dv7E8FSwYDnCgxq7y5MIW6vdnHbVzBhoSxXNLhxboAVAVvURmi32fNCebAdDU9iuOihDiCcZdObVDXQlnFqsNTZDhx543n7VjAgeaQf8J_QddSuiUXB-d9U_iAHgQh8GlIzKCYura1WNQ1-wfgq2G7eEomU1peXwFDV3ANVUc6twM May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 2630e0044e5f4f28b8d2adcfeaf0c604 May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-TestShelveInstance-366543955 May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:18:18.165779 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:18:18.167492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2630e0044e5f4f28b8d2adcfeaf0c604"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2630e0044e5f4f28b8d2adcfeaf0c604"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2630e0044e5f4f28b8d2adcfeaf0c604"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2630e0044e5f4f28b8d2adcfeaf0c604"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:18:18.167492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-TestShelveInstance-366543955 May 17 17:18:18.167492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 2630e0044e5f4f28b8d2adcfeaf0c604 May 17 17:18:18.167492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-TestShelveInstance-366543955 May 17 17:18:18.167492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-TestShelveInstance-366543955-project May 17 17:18:18.167492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:18:18.167492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:18:18.167492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 4302f72c503341d4a5367613edf38055 May 17 17:18:18.167492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-TestShelveInstance-366543955-project May 17 17:18:18.167492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:18:18.167492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance 47d1426b-07f8-410e-b753-b1d8e9c1102f could not be found. May 17 17:18:18.167492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '47d1426b-07f8-410e-b753-b1d8e9c1102f'} May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47d1426b-07f8-410e-b753-b1d8e9c1102f could not be found. May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:18:18.168616 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47d1426b-07f8-410e-b753-b1d8e9c1102f could not be found. May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47d1426b-07f8-410e-b753-b1d8e9c1102f could not be found. May 17 17:18:18.170185 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:18:18.171633 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-02f1cf6f-de43-471c-83fa-955def4b8488 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Returning 404 to user: Instance 47d1426b-07f8-410e-b753-b1d8e9c1102f could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:18:18.171633 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-02f1cf6f-de43-471c-83fa-955def4b8488 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f" status: 404 len: 111 microversion: 2.1 time: 0.030162 May 17 17:18:18.171633 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 553/1073] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:18 2022] GET /compute/v2.1/servers/47d1426b-07f8-410e-b753-b1d8e9c1102f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:18:18.324761 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-34b5fecb-5c8a-4bc4-8881-6527eda94242 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] Calling method '.version_select at 0x7feb13742670>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:18.355366 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-34b5fecb-5c8a-4bc4-8881-6527eda94242 tempest-TestShelveInstance-366543955 tempest-TestShelveInstance-366543955-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1446987121" status: 202 len: 0 microversion: 2.1 time: 0.035951 May 17 17:18:18.355991 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 521/1074] 10.222.0.48 () {58 vars in 1253 bytes} [Tue May 17 17:18:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1446987121 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:18:45.922451 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-0f8c9b35-e6c7-4531-b4f2-1d369c4326b1 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:18:45.923398 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-0f8c9b35-e6c7-4531-b4f2-1d369c4326b1 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:45.930109 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0f8c9b35-e6c7-4531-b4f2-1d369c4326b1 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:45.930559 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0f8c9b35-e6c7-4531-b4f2-1d369c4326b1 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:45.931928 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0f8c9b35-e6c7-4531-b4f2-1d369c4326b1 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:45.932364 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0f8c9b35-e6c7-4531-b4f2-1d369c4326b1 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:46.005780 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-0f8c9b35-e6c7-4531-b4f2-1d369c4326b1 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "POST /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.086806 May 17 17:18:46.006554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 554/1075] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 17 17:18:45 2022] POST /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:18:46.016047 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0f61f3d4-1a05-4673-8912-00c659bd67b4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:46.017409 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0f61f3d4-1a05-4673-8912-00c659bd67b4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:46.027480 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0f61f3d4-1a05-4673-8912-00c659bd67b4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:46.027958 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0f61f3d4-1a05-4673-8912-00c659bd67b4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:46.029056 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0f61f3d4-1a05-4673-8912-00c659bd67b4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:46.029674 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0f61f3d4-1a05-4673-8912-00c659bd67b4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:46.195874 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0f61f3d4-1a05-4673-8912-00c659bd67b4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:46.206969 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0f61f3d4-1a05-4673-8912-00c659bd67b4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1751 microversion: 2.1 time: 0.194310 May 17 17:18:46.215758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 522/1076] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:46 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:47.225441 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-cca453ff-a6c1-4d41-8236-5414560b4b17 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:47.226140 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-cca453ff-a6c1-4d41-8236-5414560b4b17 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:47.236950 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-cca453ff-a6c1-4d41-8236-5414560b4b17 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:47.237398 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-cca453ff-a6c1-4d41-8236-5414560b4b17 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:47.238164 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-cca453ff-a6c1-4d41-8236-5414560b4b17 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:47.238596 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-cca453ff-a6c1-4d41-8236-5414560b4b17 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:47.387473 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-cca453ff-a6c1-4d41-8236-5414560b4b17 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:47.395252 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-cca453ff-a6c1-4d41-8236-5414560b4b17 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1751 microversion: 2.1 time: 0.174101 May 17 17:18:47.395838 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 555/1077] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:47 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:48.413306 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-65d2ca18-bbb5-468f-81da-4412990fca1d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:48.413918 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-65d2ca18-bbb5-468f-81da-4412990fca1d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:48.420758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-65d2ca18-bbb5-468f-81da-4412990fca1d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:48.421204 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-65d2ca18-bbb5-468f-81da-4412990fca1d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:48.421963 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-65d2ca18-bbb5-468f-81da-4412990fca1d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:48.422398 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-65d2ca18-bbb5-468f-81da-4412990fca1d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:48.561490 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-65d2ca18-bbb5-468f-81da-4412990fca1d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:48.569238 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-65d2ca18-bbb5-468f-81da-4412990fca1d tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1751 microversion: 2.1 time: 0.159712 May 17 17:18:48.569793 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 523/1078] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:48 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:49.590468 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-011f2b2f-11b3-4574-85c9-cca0d2adb620 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:49.591127 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-011f2b2f-11b3-4574-85c9-cca0d2adb620 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:49.599515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-011f2b2f-11b3-4574-85c9-cca0d2adb620 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:49.600042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-011f2b2f-11b3-4574-85c9-cca0d2adb620 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:49.600872 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-011f2b2f-11b3-4574-85c9-cca0d2adb620 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:49.601307 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-011f2b2f-11b3-4574-85c9-cca0d2adb620 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:49.762548 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-011f2b2f-11b3-4574-85c9-cca0d2adb620 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:49.770288 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-011f2b2f-11b3-4574-85c9-cca0d2adb620 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.187855 May 17 17:18:49.770856 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 556/1079] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:49 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:50.787420 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-1953b687-f93a-4bfc-86c7-247805b7a3c7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:50.788063 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-1953b687-f93a-4bfc-86c7-247805b7a3c7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:50.795017 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1953b687-f93a-4bfc-86c7-247805b7a3c7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:50.795461 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1953b687-f93a-4bfc-86c7-247805b7a3c7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:50.796243 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1953b687-f93a-4bfc-86c7-247805b7a3c7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:50.796677 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-1953b687-f93a-4bfc-86c7-247805b7a3c7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:50.938661 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-1953b687-f93a-4bfc-86c7-247805b7a3c7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:50.946939 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-1953b687-f93a-4bfc-86c7-247805b7a3c7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.162812 May 17 17:18:50.947755 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 524/1080] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:50 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:51.964711 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-edd2b037-ddff-4298-bcac-58bab70a316b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:51.965333 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-edd2b037-ddff-4298-bcac-58bab70a316b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:51.971765 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-edd2b037-ddff-4298-bcac-58bab70a316b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:51.972215 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-edd2b037-ddff-4298-bcac-58bab70a316b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:51.972977 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-edd2b037-ddff-4298-bcac-58bab70a316b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:51.973413 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-edd2b037-ddff-4298-bcac-58bab70a316b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:52.115358 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-edd2b037-ddff-4298-bcac-58bab70a316b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:52.123228 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-edd2b037-ddff-4298-bcac-58bab70a316b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.163013 May 17 17:18:52.123809 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 557/1081] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:51 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:53.140912 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-fb4cd4a7-7f19-4537-af2c-6ad12cdb67c4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:53.141582 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-fb4cd4a7-7f19-4537-af2c-6ad12cdb67c4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:53.147872 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fb4cd4a7-7f19-4537-af2c-6ad12cdb67c4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:53.148320 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fb4cd4a7-7f19-4537-af2c-6ad12cdb67c4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:53.149330 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fb4cd4a7-7f19-4537-af2c-6ad12cdb67c4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:53.149761 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-fb4cd4a7-7f19-4537-af2c-6ad12cdb67c4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:53.291239 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-fb4cd4a7-7f19-4537-af2c-6ad12cdb67c4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:53.299417 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-fb4cd4a7-7f19-4537-af2c-6ad12cdb67c4 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.162937 May 17 17:18:53.300271 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 525/1082] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:53 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:54.316461 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-58587bc4-033b-40dd-baee-335d9ebc2f57 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:54.317074 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-58587bc4-033b-40dd-baee-335d9ebc2f57 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:54.323329 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-58587bc4-033b-40dd-baee-335d9ebc2f57 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:54.323817 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-58587bc4-033b-40dd-baee-335d9ebc2f57 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:54.324582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-58587bc4-033b-40dd-baee-335d9ebc2f57 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:54.325019 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-58587bc4-033b-40dd-baee-335d9ebc2f57 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:54.467287 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-58587bc4-033b-40dd-baee-335d9ebc2f57 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:54.475773 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-58587bc4-033b-40dd-baee-335d9ebc2f57 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.163034 May 17 17:18:54.476338 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 558/1083] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:54 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:55.493716 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-c87c6966-b08c-41c0-b324-36bb72050c72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:55.494347 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-c87c6966-b08c-41c0-b324-36bb72050c72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:55.500744 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c87c6966-b08c-41c0-b324-36bb72050c72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:55.501268 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c87c6966-b08c-41c0-b324-36bb72050c72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:55.502030 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c87c6966-b08c-41c0-b324-36bb72050c72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:55.502467 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c87c6966-b08c-41c0-b324-36bb72050c72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:55.642484 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-c87c6966-b08c-41c0-b324-36bb72050c72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:55.650420 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-c87c6966-b08c-41c0-b324-36bb72050c72 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.160562 May 17 17:18:55.650978 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 526/1084] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:55 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:56.666541 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-0c3ee0e6-ecf5-4b71-85a2-e2b807b9a5b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:56.667180 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-0c3ee0e6-ecf5-4b71-85a2-e2b807b9a5b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:56.673654 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0c3ee0e6-ecf5-4b71-85a2-e2b807b9a5b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:56.674101 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0c3ee0e6-ecf5-4b71-85a2-e2b807b9a5b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:56.674857 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0c3ee0e6-ecf5-4b71-85a2-e2b807b9a5b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:56.675286 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-0c3ee0e6-ecf5-4b71-85a2-e2b807b9a5b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:56.827231 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-0c3ee0e6-ecf5-4b71-85a2-e2b807b9a5b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:56.835803 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-0c3ee0e6-ecf5-4b71-85a2-e2b807b9a5b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.173124 May 17 17:18:56.836437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 559/1085] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:56 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:57.854013 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-97dc8fde-2cd6-4381-b763-28545578d0b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:57.854623 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-97dc8fde-2cd6-4381-b763-28545578d0b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:57.861445 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-97dc8fde-2cd6-4381-b763-28545578d0b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:57.861894 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-97dc8fde-2cd6-4381-b763-28545578d0b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:57.862656 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-97dc8fde-2cd6-4381-b763-28545578d0b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:57.863092 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-97dc8fde-2cd6-4381-b763-28545578d0b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:58.006466 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-97dc8fde-2cd6-4381-b763-28545578d0b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:58.014364 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-97dc8fde-2cd6-4381-b763-28545578d0b7 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.164126 May 17 17:18:58.014939 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 527/1086] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:57 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:18:59.032524 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5ba24dd1-317b-4303-ba98-edb2cac65212 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:18:59.033137 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5ba24dd1-317b-4303-ba98-edb2cac65212 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:18:59.039708 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5ba24dd1-317b-4303-ba98-edb2cac65212 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:59.040247 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5ba24dd1-317b-4303-ba98-edb2cac65212 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:59.040987 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5ba24dd1-317b-4303-ba98-edb2cac65212 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:18:59.041420 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5ba24dd1-317b-4303-ba98-edb2cac65212 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:18:59.181582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5ba24dd1-317b-4303-ba98-edb2cac65212 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:18:59.189446 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5ba24dd1-317b-4303-ba98-edb2cac65212 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.161051 May 17 17:18:59.190017 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 560/1087] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:18:59 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:00.206271 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-080ce52f-2a6a-4819-843f-8ed904b88718 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:00.206883 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-080ce52f-2a6a-4819-843f-8ed904b88718 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:00.213158 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-080ce52f-2a6a-4819-843f-8ed904b88718 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:00.213602 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-080ce52f-2a6a-4819-843f-8ed904b88718 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:00.214360 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-080ce52f-2a6a-4819-843f-8ed904b88718 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:00.215296 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-080ce52f-2a6a-4819-843f-8ed904b88718 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:00.355678 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-080ce52f-2a6a-4819-843f-8ed904b88718 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:00.364209 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-080ce52f-2a6a-4819-843f-8ed904b88718 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.161881 May 17 17:19:00.364770 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 528/1088] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:00 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:01.381700 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a195f4e7-c252-4c84-a23b-f82a7d6bcd08 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:01.382900 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a195f4e7-c252-4c84-a23b-f82a7d6bcd08 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:01.392582 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a195f4e7-c252-4c84-a23b-f82a7d6bcd08 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:01.393030 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a195f4e7-c252-4c84-a23b-f82a7d6bcd08 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:01.393806 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a195f4e7-c252-4c84-a23b-f82a7d6bcd08 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:01.394244 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a195f4e7-c252-4c84-a23b-f82a7d6bcd08 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:01.612721 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a195f4e7-c252-4c84-a23b-f82a7d6bcd08 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:01.621062 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a195f4e7-c252-4c84-a23b-f82a7d6bcd08 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.243197 May 17 17:19:01.621635 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 561/1089] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:01 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:02.638656 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-999dcf60-7b5e-43ac-abe9-543b4c458372 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:02.639274 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-999dcf60-7b5e-43ac-abe9-543b4c458372 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:02.645552 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-999dcf60-7b5e-43ac-abe9-543b4c458372 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:02.645996 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-999dcf60-7b5e-43ac-abe9-543b4c458372 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:02.646749 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-999dcf60-7b5e-43ac-abe9-543b4c458372 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:02.647178 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-999dcf60-7b5e-43ac-abe9-543b4c458372 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:02.787819 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-999dcf60-7b5e-43ac-abe9-543b4c458372 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:02.800581 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-999dcf60-7b5e-43ac-abe9-543b4c458372 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.166359 May 17 17:19:02.801144 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 529/1090] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:02 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:03.818845 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-8b790373-a307-4335-a409-008bd434fd33 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:03.819438 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-8b790373-a307-4335-a409-008bd434fd33 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:03.827173 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8b790373-a307-4335-a409-008bd434fd33 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:03.827658 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8b790373-a307-4335-a409-008bd434fd33 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:03.828437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8b790373-a307-4335-a409-008bd434fd33 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:03.828907 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-8b790373-a307-4335-a409-008bd434fd33 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:03.971890 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-8b790373-a307-4335-a409-008bd434fd33 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:03.979691 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-8b790373-a307-4335-a409-008bd434fd33 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.164716 May 17 17:19:03.980257 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 562/1091] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:03 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:04.996535 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d58b0d18-fc85-40c7-b6ed-b8e727e88ede tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:04.997171 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d58b0d18-fc85-40c7-b6ed-b8e727e88ede tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:05.003490 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d58b0d18-fc85-40c7-b6ed-b8e727e88ede tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:05.003968 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d58b0d18-fc85-40c7-b6ed-b8e727e88ede tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:05.004726 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d58b0d18-fc85-40c7-b6ed-b8e727e88ede tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:05.005166 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d58b0d18-fc85-40c7-b6ed-b8e727e88ede tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:05.144435 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d58b0d18-fc85-40c7-b6ed-b8e727e88ede tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:05.152467 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d58b0d18-fc85-40c7-b6ed-b8e727e88ede tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.159783 May 17 17:19:05.153030 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 530/1092] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:04 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:05.975771 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:19:05.976350 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Tue May 17 17:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:19:06.171164 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-3456d10b-fac5-49c4-9f9b-4ae6c5236094 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:06.171824 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-3456d10b-fac5-49c4-9f9b-4ae6c5236094 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:06.178882 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3456d10b-fac5-49c4-9f9b-4ae6c5236094 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:06.179329 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3456d10b-fac5-49c4-9f9b-4ae6c5236094 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:06.180125 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3456d10b-fac5-49c4-9f9b-4ae6c5236094 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:06.180557 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-3456d10b-fac5-49c4-9f9b-4ae6c5236094 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:06.320439 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-3456d10b-fac5-49c4-9f9b-4ae6c5236094 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:06.328882 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-3456d10b-fac5-49c4-9f9b-4ae6c5236094 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1756 microversion: 2.1 time: 0.162520 May 17 17:19:06.329442 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 563/1093] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:06 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:07.346413 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0bb32984-5d9b-424c-a662-c26b5441adef tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:07.347014 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0bb32984-5d9b-424c-a662-c26b5441adef tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:07.353401 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0bb32984-5d9b-424c-a662-c26b5441adef tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:07.353850 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0bb32984-5d9b-424c-a662-c26b5441adef tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:07.354606 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0bb32984-5d9b-424c-a662-c26b5441adef tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:07.355044 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0bb32984-5d9b-424c-a662-c26b5441adef tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:07.497912 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-0bb32984-5d9b-424c-a662-c26b5441adef tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:07.505729 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0bb32984-5d9b-424c-a662-c26b5441adef tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1759 microversion: 2.1 time: 0.163203 May 17 17:19:07.506284 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 531/1094] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:07 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:39.971328 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-206ef05c-51c9-4cbd-a7a8-4bf873f81691 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-878442003"}} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:19:39.971993 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-206ef05c-51c9-4cbd-a7a8-4bf873f81691 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:39.978856 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-206ef05c-51c9-4cbd-a7a8-4bf873f81691 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:39.979302 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-206ef05c-51c9-4cbd-a7a8-4bf873f81691 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:39.980087 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-206ef05c-51c9-4cbd-a7a8-4bf873f81691 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:39.980544 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-206ef05c-51c9-4cbd-a7a8-4bf873f81691 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:40.103886 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.network.security_group_api [None req-206ef05c-51c9-4cbd-a7a8-4bf873f81691 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Removing security group 5786b2ea-a989-4589-b327-0930d16c877f from port 71199a70-f362-4ec1-8023-8d7cd045f666 May 17 17:19:40.476280 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-a4ea8e1b-063a-42c6-9788-26008c78b9be req-86f33e7a-872c-4354-9528-27eba9b7ce3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa95d7a-9071-46b7-bff5-c6d3fa54d1d3", "tag": "71199a70-f362-4ec1-8023-8d7cd045f666"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:19:40.479573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-206ef05c-51c9-4cbd-a7a8-4bf873f81691 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "POST /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.511867 May 17 17:19:40.480913 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 564/1095] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 17 17:19:39 2022] POST /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:19:40.485436 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-a4ea8e1b-063a-42c6-9788-26008c78b9be req-86f33e7a-872c-4354-9528-27eba9b7ce3d service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:40.485436 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-a4ea8e1b-063a-42c6-9788-26008c78b9be req-86f33e7a-872c-4354-9528-27eba9b7ce3d service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:40.501186 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-a4ea8e1b-063a-42c6-9788-26008c78b9be req-86f33e7a-872c-4354-9528-27eba9b7ce3d service nova] Creating event network-changed:71199a70-f362-4ec1-8023-8d7cd045f666 for instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 on hv-cinder-84214 May 17 17:19:40.512922 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-a4ea8e1b-063a-42c6-9788-26008c78b9be req-86f33e7a-872c-4354-9528-27eba9b7ce3d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040935 May 17 17:19:40.515229 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 532/1096] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:19:41.673760 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-35786fb2-a234-41ac-900b-23d49bc3ef92 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:41.674325 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-35786fb2-a234-41ac-900b-23d49bc3ef92 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:41.681083 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-35786fb2-a234-41ac-900b-23d49bc3ef92 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:41.681536 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-35786fb2-a234-41ac-900b-23d49bc3ef92 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:41.682308 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-35786fb2-a234-41ac-900b-23d49bc3ef92 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:41.682747 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-35786fb2-a234-41ac-900b-23d49bc3ef92 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:41.765936 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.objects.instance [None req-35786fb2-a234-41ac-900b-23d49bc3ef92 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lazy-loading 'services' on Instance uuid daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 {{(pid=117090) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:19:41.839216 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-35786fb2-a234-41ac-900b-23d49bc3ef92 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "DELETE /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/os-volume_attachments/6e20086a-8518-4367-a78a-e19dcc74b583" status: 202 len: 0 microversion: 2.1 time: 0.169524 May 17 17:19:41.839865 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 565/1097] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 17 17:19:41 2022] DELETE /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/os-volume_attachments/6e20086a-8518-4367-a78a-e19dcc74b583 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:19:41.849627 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7656ebb7-e437-448a-9978-5c711d0c7e19 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:41.850651 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7656ebb7-e437-448a-9978-5c711d0c7e19 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:41.857392 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7656ebb7-e437-448a-9978-5c711d0c7e19 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:41.857850 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7656ebb7-e437-448a-9978-5c711d0c7e19 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:41.858756 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7656ebb7-e437-448a-9978-5c711d0c7e19 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:41.859190 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7656ebb7-e437-448a-9978-5c711d0c7e19 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:41.893539 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7656ebb7-e437-448a-9978-5c711d0c7e19 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048927 May 17 17:19:41.894124 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 533/1098] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:19:41 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:19:42.532548 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-a405bc06-01ef-4ca2-a8b6-cede14beb456 req-f699c792-2c2a-4898-9691-a953dec1455a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa95d7a-9071-46b7-bff5-c6d3fa54d1d3", "tag": "71199a70-f362-4ec1-8023-8d7cd045f666"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:19:42.541410 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-a405bc06-01ef-4ca2-a8b6-cede14beb456 req-f699c792-2c2a-4898-9691-a953dec1455a service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:42.541885 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-a405bc06-01ef-4ca2-a8b6-cede14beb456 req-f699c792-2c2a-4898-9691-a953dec1455a service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:42.553312 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-a405bc06-01ef-4ca2-a8b6-cede14beb456 req-f699c792-2c2a-4898-9691-a953dec1455a service nova] Creating event network-changed:71199a70-f362-4ec1-8023-8d7cd045f666 for instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 on hv-cinder-84214 May 17 17:19:42.558537 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-a405bc06-01ef-4ca2-a8b6-cede14beb456 req-f699c792-2c2a-4898-9691-a953dec1455a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029803 May 17 17:19:42.559422 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 566/1099] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:19:42.886153 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-100447589", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-402373830", "security_groups": [{"name": "tempest-secgroup-smoke-927017117"}], "block_device_mapping_v2": [{"uuid": "69cf4770-fe69-4c5f-a675-69fdf4aa6a01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f954c18a-8821-47ca-8b80-a2fbc154db5e"}]}} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:19:42.907951 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-2e716603-1533-4615-be4d-d2d23ed8fbc9 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:42.909721 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-2e716603-1533-4615-be4d-d2d23ed8fbc9 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:42.917068 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2e716603-1533-4615-be4d-d2d23ed8fbc9 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:42.917617 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2e716603-1533-4615-be4d-d2d23ed8fbc9 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:42.918468 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2e716603-1533-4615-be4d-d2d23ed8fbc9 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:42.919013 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-2e716603-1533-4615-be4d-d2d23ed8fbc9 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:42.951566 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-2e716603-1533-4615-be4d-d2d23ed8fbc9 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048965 May 17 17:19:42.952539 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 567/1100] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 17 17:19:42 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 17 17:19:42.968587 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-904042e9-9c34-4406-be88-220f4e6ad329 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:42.969172 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-904042e9-9c34-4406-be88-220f4e6ad329 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:42.976167 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-904042e9-9c34-4406-be88-220f4e6ad329 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:42.976881 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-904042e9-9c34-4406-be88-220f4e6ad329 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:42.977667 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-904042e9-9c34-4406-be88-220f4e6ad329 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:42.978107 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-904042e9-9c34-4406-be88-220f4e6ad329 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:43.004022 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.network.neutron [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] validate_networks() for [('f954c18a-8821-47ca-8b80-a2fbc154db5e', None, None, None, None, None)] {{(pid=117089) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:19:43.056243 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-904042e9-9c34-4406-be88-220f4e6ad329 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] HTTP exception thrown: Instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 is not attached to volume 6e20086a-8518-4367-a78a-e19dcc74b583 May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-904042e9-9c34-4406-be88-220f4e6ad329 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Request method failure captured: May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: DELETE /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/os-volume_attachments/6e20086a-8518-4367-a78a-e19dcc74b583 HTTP/1.1 May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9iblCi8IsK7bZC9upW3wGzi4IIxOonj7iAFlmjSK3QtOKDkCkF4gjnIOcxTLVh7p1Wzivm7wBBZH9Lm4zeYu_Z-ZN4tl2R94-1ZiQ3u8wVSA5AMlZDno51IGd9eoPxkgDQI4Db34SaDrXuwbD6H4Qd49yUb6Zn6B3z2BDNFORiMGl4 May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: 21c32c98238c44e7a3581a668e1a5ea3 May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-TestMinimumBasicScenario-2037747782 May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:19:43.058554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:19:43.060105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21c32c98238c44e7a3581a668e1a5ea3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_21c32c98238c44e7a3581a668e1a5ea3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/21c32c98238c44e7a3581a668e1a5ea3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21c32c98238c44e7a3581a668e1a5ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:19:43.060105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-TestMinimumBasicScenario-2037747782 May 17 17:19:43.060105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: 21c32c98238c44e7a3581a668e1a5ea3 May 17 17:19:43.060105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2037747782 May 17 17:19:43.060105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-TestMinimumBasicScenario-2037747782-project May 17 17:19:43.060105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:19:43.060105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:19:43.060105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: b62f5ec1700d4a86aab654c9f2eb0201 May 17 17:19:43.060105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-TestMinimumBasicScenario-2037747782-project May 17 17:19:43.060105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:19:43.060105 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 is not attached to volume 6e20086a-8518-4367-a78a-e19dcc74b583 May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'server_id': 'daa95d7a-9071-46b7-bff5-c6d3fa54d1d3', 'id': '6e20086a-8518-4367-a78a-e19dcc74b583'} May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6e20086a-8518-4367-a78a-e19dcc74b583. May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:19:43.060889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 is not attached to volume 6e20086a-8518-4367-a78a-e19dcc74b583 May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 is not attached to volume 6e20086a-8518-4367-a78a-e19dcc74b583 May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:19:43.062205 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-904042e9-9c34-4406-be88-220f4e6ad329 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Returning 404 to user: Instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 is not attached to volume 6e20086a-8518-4367-a78a-e19dcc74b583 {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:19:43.063239 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-904042e9-9c34-4406-be88-220f4e6ad329 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "DELETE /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/os-volume_attachments/6e20086a-8518-4367-a78a-e19dcc74b583" status: 404 len: 154 microversion: 2.1 time: 0.095572 May 17 17:19:43.063239 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 568/1101] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 17 17:19:42 2022] DELETE /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3/os-volume_attachments/6e20086a-8518-4367-a78a-e19dcc74b583 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:19:43.383266 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Flavor limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:19:43.383725 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Image limits 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:19:43.384210 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Flavor pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:19:43.384615 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Image pref 0:0:0 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:19:43.385095 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.virt.hardware [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:19:43.394784 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:43.395168 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:43.396611 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:43.397049 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:43.413147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Getting quotas for project b1528992e3c74c08b5c4192466f23852. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:19:43.417017 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.quota [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Getting quotas for user 38bdb5f8e08e49358f9f27e4f1ce167b and project b1528992e3c74c08b5c4192466f23852. Resources: {'ram', 'instances', 'cores'} {{(pid=117089) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:19:43.472238 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Going to run 1 instances... {{(pid=117089) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:19:43.474577 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69cf4770-fe69-4c5f-a675-69fdf4aa6a01',volume_size=None,volume_type=None)] {{(pid=117089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:19:43.597488 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-c637ed94-1ed3-4e60-8b4c-81416bf8904f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.716164 May 17 17:19:43.598123 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 534/1102] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 17 17:19:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:19:43.608562 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b6da0a3e-5fac-4ae4-896b-94fa6ca5046f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:43.609175 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b6da0a3e-5fac-4ae4-896b-94fa6ca5046f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:43.662729 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b6da0a3e-5fac-4ae4-896b-94fa6ca5046f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:43.669190 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b6da0a3e-5fac-4ae4-896b-94fa6ca5046f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1093 microversion: 2.1 time: 0.064468 May 17 17:19:43.669738 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 569/1103] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:43 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:44.199253 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a9d607fe-71d8-414c-bb40-98aef38b9a47 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:44.199812 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a9d607fe-71d8-414c-bb40-98aef38b9a47 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:44.206416 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9d607fe-71d8-414c-bb40-98aef38b9a47 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:44.206863 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9d607fe-71d8-414c-bb40-98aef38b9a47 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:44.207648 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9d607fe-71d8-414c-bb40-98aef38b9a47 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:44.208090 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a9d607fe-71d8-414c-bb40-98aef38b9a47 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:44.232553 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a9d607fe-71d8-414c-bb40-98aef38b9a47 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Going to try to terminate instance {{(pid=117089) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:19:44.304780 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a9d607fe-71d8-414c-bb40-98aef38b9a47 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "DELETE /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 204 len: 0 microversion: 2.1 time: 0.109090 May 17 17:19:44.305345 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 535/1104] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:19:44 2022] DELETE /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:19:44.313411 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-a54d25de-e0ef-4b2d-be81-eb2f7eb8ca7c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:44.314103 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-a54d25de-e0ef-4b2d-be81-eb2f7eb8ca7c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:44.321974 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a54d25de-e0ef-4b2d-be81-eb2f7eb8ca7c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:44.322421 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a54d25de-e0ef-4b2d-be81-eb2f7eb8ca7c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:44.323228 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a54d25de-e0ef-4b2d-be81-eb2f7eb8ca7c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:44.323694 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-a54d25de-e0ef-4b2d-be81-eb2f7eb8ca7c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:44.457373 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-a54d25de-e0ef-4b2d-be81-eb2f7eb8ca7c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:44.465091 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-a54d25de-e0ef-4b2d-be81-eb2f7eb8ca7c tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1554 microversion: 2.1 time: 0.155528 May 17 17:19:44.466283 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 570/1105] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:44 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:44.687632 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-3a1634c3-7712-4667-827a-350a8f8bf72a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:44.688450 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-3a1634c3-7712-4667-827a-350a8f8bf72a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:44.695147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a1634c3-7712-4667-827a-350a8f8bf72a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:44.695613 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a1634c3-7712-4667-827a-350a8f8bf72a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:44.696379 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a1634c3-7712-4667-827a-350a8f8bf72a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:44.696809 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-3a1634c3-7712-4667-827a-350a8f8bf72a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:44.758710 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-3a1634c3-7712-4667-827a-350a8f8bf72a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:44.765930 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-3a1634c3-7712-4667-827a-350a8f8bf72a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1199 microversion: 2.1 time: 0.082625 May 17 17:19:44.766483 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 536/1106] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:44 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:45.482710 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b0c9336d-6ea5-46fc-90fa-bb542e78487b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:45.483262 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-b0c9336d-6ea5-46fc-90fa-bb542e78487b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:45.489772 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b0c9336d-6ea5-46fc-90fa-bb542e78487b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:45.490362 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b0c9336d-6ea5-46fc-90fa-bb542e78487b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:45.491143 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b0c9336d-6ea5-46fc-90fa-bb542e78487b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:45.491573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-b0c9336d-6ea5-46fc-90fa-bb542e78487b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:45.617079 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-b0c9336d-6ea5-46fc-90fa-bb542e78487b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:45.624414 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b0c9336d-6ea5-46fc-90fa-bb542e78487b tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1554 microversion: 2.1 time: 0.145581 May 17 17:19:45.624984 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 571/1107] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:45 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:19:45.784714 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4ea6bb3b-bc0c-4cc3-af55-2f4a9e4dc641 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:45.785946 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4ea6bb3b-bc0c-4cc3-af55-2f4a9e4dc641 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:45.795291 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4ea6bb3b-bc0c-4cc3-af55-2f4a9e4dc641 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:45.795782 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4ea6bb3b-bc0c-4cc3-af55-2f4a9e4dc641 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:45.796562 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4ea6bb3b-bc0c-4cc3-af55-2f4a9e4dc641 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:45.797122 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4ea6bb3b-bc0c-4cc3-af55-2f4a9e4dc641 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:45.866008 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-4ea6bb3b-bc0c-4cc3-af55-2f4a9e4dc641 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:45.874529 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4ea6bb3b-bc0c-4cc3-af55-2f4a9e4dc641 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1199 microversion: 2.1 time: 0.094813 May 17 17:19:45.875094 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 537/1108] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:45 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1199 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:46.642735 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7ef33528-3375-43e0-b10a-d1814a40f174 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:46.643276 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7ef33528-3375-43e0-b10a-d1814a40f174 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:46.649990 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7ef33528-3375-43e0-b10a-d1814a40f174 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:46.650436 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7ef33528-3375-43e0-b10a-d1814a40f174 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:46.651201 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7ef33528-3375-43e0-b10a-d1814a40f174 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:46.651652 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7ef33528-3375-43e0-b10a-d1814a40f174 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:46.794827 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7ef33528-3375-43e0-b10a-d1814a40f174 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f5ec1700d4a86aab654c9f2eb0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c32c98238c44e7a3581a668e1a5ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:46.802665 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7ef33528-3375-43e0-b10a-d1814a40f174 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 200 len: 1554 microversion: 2.1 time: 0.164096 May 17 17:19:46.803387 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 572/1109] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:46 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:46.851703 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [req-a25b03a9-e87e-466a-8688-f41f1b4bddfa req-adf53215-7852-4386-95ee-99c410737220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa95d7a-9071-46b7-bff5-c6d3fa54d1d3", "name": "network-vif-deleted", "tag": "71199a70-f362-4ec1-8023-8d7cd045f666"}]} {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:19:46.860455 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-a25b03a9-e87e-466a-8688-f41f1b4bddfa req-adf53215-7852-4386-95ee-99c410737220 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:46.861331 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [req-a25b03a9-e87e-466a-8688-f41f1b4bddfa req-adf53215-7852-4386-95ee-99c410737220 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:46.876319 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.compute.server_external_events [req-a25b03a9-e87e-466a-8688-f41f1b4bddfa req-adf53215-7852-4386-95ee-99c410737220 service nova] Creating event network-vif-deleted:71199a70-f362-4ec1-8023-8d7cd045f666 for instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 on hv-cinder-84214 May 17 17:19:46.882647 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [req-a25b03a9-e87e-466a-8688-f41f1b4bddfa req-adf53215-7852-4386-95ee-99c410737220 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034866 May 17 17:19:46.883346 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 538/1110] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:19:46.892453 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-80fdd877-fd63-4c40-bf0c-7257fd98c7b6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:46.893099 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-80fdd877-fd63-4c40-bf0c-7257fd98c7b6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:46.903019 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-80fdd877-fd63-4c40-bf0c-7257fd98c7b6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:46.903468 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-80fdd877-fd63-4c40-bf0c-7257fd98c7b6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:46.904281 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-80fdd877-fd63-4c40-bf0c-7257fd98c7b6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:46.904952 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-80fdd877-fd63-4c40-bf0c-7257fd98c7b6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:47.060400 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-80fdd877-fd63-4c40-bf0c-7257fd98c7b6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:47.069397 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-80fdd877-fd63-4c40-bf0c-7257fd98c7b6 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1264 microversion: 2.1 time: 0.180811 May 17 17:19:47.070333 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 573/1111] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:46 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:47.820491 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4c7f3c51-7101-4531-8177-a7b5474acf84 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:47.821286 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-4c7f3c51-7101-4531-8177-a7b5474acf84 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] [instance: daa95d7a-9071-46b7-bff5-c6d3fa54d1d3] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:47.827385 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c7f3c51-7101-4531-8177-a7b5474acf84 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:47.827962 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c7f3c51-7101-4531-8177-a7b5474acf84 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:47.828818 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c7f3c51-7101-4531-8177-a7b5474acf84 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:47.829327 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-4c7f3c51-7101-4531-8177-a7b5474acf84 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:47.842925 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-4c7f3c51-7101-4531-8177-a7b5474acf84 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] HTTP exception thrown: Instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 could not be found. May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4c7f3c51-7101-4531-8177-a7b5474acf84 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Request method failure captured: May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 HTTP/1.1 May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9iblCi8IsK7bZC9upW3wGzi4IIxOonj7iAFlmjSK3QtOKDkCkF4gjnIOcxTLVh7p1Wzivm7wBBZH9Lm4zeYu_Z-ZN4tl2R94-1ZiQ3u8wVSA5AMlZDno51IGd9eoPxkgDQI4Db34SaDrXuwbD6H4Qd49yUb6Zn6B3z2BDNFORiMGl4 May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: 21c32c98238c44e7a3581a668e1a5ea3 May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-TestMinimumBasicScenario-2037747782 May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:19:47.844834 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:19:47.846521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21c32c98238c44e7a3581a668e1a5ea3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_21c32c98238c44e7a3581a668e1a5ea3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/21c32c98238c44e7a3581a668e1a5ea3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21c32c98238c44e7a3581a668e1a5ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:19:47.846521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-TestMinimumBasicScenario-2037747782 May 17 17:19:47.846521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: 21c32c98238c44e7a3581a668e1a5ea3 May 17 17:19:47.846521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2037747782 May 17 17:19:47.846521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-TestMinimumBasicScenario-2037747782-project May 17 17:19:47.846521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:19:47.846521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:19:47.846521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: b62f5ec1700d4a86aab654c9f2eb0201 May 17 17:19:47.846521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-TestMinimumBasicScenario-2037747782-project May 17 17:19:47.846521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:19:47.846521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 could not be found. May 17 17:19:47.846521 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': 'daa95d7a-9071-46b7-bff5-c6d3fa54d1d3'} May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 could not be found. May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:19:47.847563 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 could not be found. May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 could not be found. May 17 17:19:47.849283 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:19:47.850827 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-4c7f3c51-7101-4531-8177-a7b5474acf84 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Returning 404 to user: Instance daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:19:47.850827 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-4c7f3c51-7101-4531-8177-a7b5474acf84 tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3" status: 404 len: 111 microversion: 2.1 time: 0.031675 May 17 17:19:47.850827 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 539/1112] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:47 2022] GET /compute/v2.1/servers/daa95d7a-9071-46b7-bff5-c6d3fa54d1d3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:19:47.857135 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-b89c5e9b-f1e4-4f2b-bfc2-ed749150311e tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] Calling method '.version_select at 0x7feb12fecdc0>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:47.876492 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-b89c5e9b-f1e4-4f2b-bfc2-ed749150311e tempest-TestMinimumBasicScenario-2037747782 tempest-TestMinimumBasicScenario-2037747782-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2002295584" status: 202 len: 0 microversion: 2.1 time: 0.023014 May 17 17:19:47.877346 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 574/1113] 10.222.0.48 () {58 vars in 1271 bytes} [Tue May 17 17:19:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2002295584 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:19:48.086889 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-56648380-7a34-46d1-9645-2206176ec80f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:48.087730 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-56648380-7a34-46d1-9645-2206176ec80f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:48.094296 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-56648380-7a34-46d1-9645-2206176ec80f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:48.094753 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-56648380-7a34-46d1-9645-2206176ec80f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:48.095535 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-56648380-7a34-46d1-9645-2206176ec80f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:48.096021 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-56648380-7a34-46d1-9645-2206176ec80f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:48.238094 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-56648380-7a34-46d1-9645-2206176ec80f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:48.246423 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-56648380-7a34-46d1-9645-2206176ec80f tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1264 microversion: 2.1 time: 0.164125 May 17 17:19:48.247083 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 540/1114] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:48 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:48.913624 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-cab55763-14d7-4951-b6d6-7055528bffee req-80b636e7-d933-4c02-8c26-1e363d51ea71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01cf2a3e-c99c-42a1-96e9-de3c325a36dc", "tag": "22214f5c-49e6-4040-b1ae-7be35f8961e4"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:19:48.922554 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-cab55763-14d7-4951-b6d6-7055528bffee req-80b636e7-d933-4c02-8c26-1e363d51ea71 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:48.923557 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-cab55763-14d7-4951-b6d6-7055528bffee req-80b636e7-d933-4c02-8c26-1e363d51ea71 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:48.934501 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-cab55763-14d7-4951-b6d6-7055528bffee req-80b636e7-d933-4c02-8c26-1e363d51ea71 service nova] Creating event network-changed:22214f5c-49e6-4040-b1ae-7be35f8961e4 for instance 01cf2a3e-c99c-42a1-96e9-de3c325a36dc on hv-cinder-84214 May 17 17:19:48.939357 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-cab55763-14d7-4951-b6d6-7055528bffee req-80b636e7-d933-4c02-8c26-1e363d51ea71 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030632 May 17 17:19:48.940436 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 575/1115] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:19:49.263875 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-176ba16d-43f1-4da9-a735-22fc5d1fe695 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:49.264546 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-176ba16d-43f1-4da9-a735-22fc5d1fe695 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:49.272560 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-176ba16d-43f1-4da9-a735-22fc5d1fe695 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:49.273299 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-176ba16d-43f1-4da9-a735-22fc5d1fe695 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:49.274149 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-176ba16d-43f1-4da9-a735-22fc5d1fe695 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:49.274592 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-176ba16d-43f1-4da9-a735-22fc5d1fe695 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:49.482622 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-176ba16d-43f1-4da9-a735-22fc5d1fe695 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:49.489887 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-176ba16d-43f1-4da9-a735-22fc5d1fe695 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1264 microversion: 2.1 time: 0.230012 May 17 17:19:49.490447 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 541/1116] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:49 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:50.509485 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-dac310f1-cb7b-4b99-8335-ce970e33cf9a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:50.510396 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-dac310f1-cb7b-4b99-8335-ce970e33cf9a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:50.518503 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dac310f1-cb7b-4b99-8335-ce970e33cf9a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:50.519078 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dac310f1-cb7b-4b99-8335-ce970e33cf9a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:50.520002 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dac310f1-cb7b-4b99-8335-ce970e33cf9a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:50.521184 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dac310f1-cb7b-4b99-8335-ce970e33cf9a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:50.732101 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-dac310f1-cb7b-4b99-8335-ce970e33cf9a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:50.739491 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-dac310f1-cb7b-4b99-8335-ce970e33cf9a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1264 microversion: 2.1 time: 0.236876 May 17 17:19:50.740095 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 576/1117] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:50 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:51.758328 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-dbe30da7-0979-450f-a893-8ee959299eda tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:51.758947 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-dbe30da7-0979-450f-a893-8ee959299eda tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:51.765361 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dbe30da7-0979-450f-a893-8ee959299eda tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:51.765953 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dbe30da7-0979-450f-a893-8ee959299eda tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:51.766736 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dbe30da7-0979-450f-a893-8ee959299eda tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:51.767181 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-dbe30da7-0979-450f-a893-8ee959299eda tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:52.001641 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-dbe30da7-0979-450f-a893-8ee959299eda tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:52.009758 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-dbe30da7-0979-450f-a893-8ee959299eda tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1264 microversion: 2.1 time: 0.256550 May 17 17:19:52.010325 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 542/1118] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:51 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1264 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:53.027193 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-1e37d97f-601a-4494-9477-31d66c82b962 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:53.028127 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-1e37d97f-601a-4494-9477-31d66c82b962 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:53.035425 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1e37d97f-601a-4494-9477-31d66c82b962 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:53.036865 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1e37d97f-601a-4494-9477-31d66c82b962 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:53.037741 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1e37d97f-601a-4494-9477-31d66c82b962 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:53.038312 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-1e37d97f-601a-4494-9477-31d66c82b962 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:53.273174 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-1e37d97f-601a-4494-9477-31d66c82b962 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:53.280515 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-1e37d97f-601a-4494-9477-31d66c82b962 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1264 microversion: 2.1 time: 0.257105 May 17 17:19:53.281085 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 577/1119] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:53 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1264 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:54.297816 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7e1c8136-2168-4fab-ad9a-182ab5c4b902 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:54.298624 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-7e1c8136-2168-4fab-ad9a-182ab5c4b902 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:54.311355 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e1c8136-2168-4fab-ad9a-182ab5c4b902 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:54.311675 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e1c8136-2168-4fab-ad9a-182ab5c4b902 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:54.312469 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e1c8136-2168-4fab-ad9a-182ab5c4b902 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:54.312906 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-7e1c8136-2168-4fab-ad9a-182ab5c4b902 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:54.485170 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-7e1c8136-2168-4fab-ad9a-182ab5c4b902 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:54.495147 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7e1c8136-2168-4fab-ad9a-182ab5c4b902 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1264 microversion: 2.1 time: 0.201351 May 17 17:19:54.495742 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 543/1120] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:54 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:55.512274 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-14c6c36c-d391-47c0-a72c-3f6ddf264e22 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:55.513037 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-14c6c36c-d391-47c0-a72c-3f6ddf264e22 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:55.521650 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-14c6c36c-d391-47c0-a72c-3f6ddf264e22 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:55.522538 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-14c6c36c-d391-47c0-a72c-3f6ddf264e22 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:55.523468 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-14c6c36c-d391-47c0-a72c-3f6ddf264e22 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:55.523942 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-14c6c36c-d391-47c0-a72c-3f6ddf264e22 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:55.671395 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-14c6c36c-d391-47c0-a72c-3f6ddf264e22 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:55.679909 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-14c6c36c-d391-47c0-a72c-3f6ddf264e22 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1264 microversion: 2.1 time: 0.171604 May 17 17:19:55.680481 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 578/1121] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:55 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:56.697210 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-e7725d4a-369e-4219-a3c4-78af533857bf tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:56.697742 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-e7725d4a-369e-4219-a3c4-78af533857bf tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:56.704059 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e7725d4a-369e-4219-a3c4-78af533857bf tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:56.704508 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e7725d4a-369e-4219-a3c4-78af533857bf tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:56.705267 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e7725d4a-369e-4219-a3c4-78af533857bf tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:56.705700 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-e7725d4a-369e-4219-a3c4-78af533857bf tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:56.834846 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-e7725d4a-369e-4219-a3c4-78af533857bf tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:56.842060 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-e7725d4a-369e-4219-a3c4-78af533857bf tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1264 microversion: 2.1 time: 0.148780 May 17 17:19:56.842631 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 544/1122] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:56 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:19:57.604868 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-e7895ab4-1323-479d-bf14-df655d1ddc5e req-82cb9358-8559-4150-bf56-8e4218c6e94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01cf2a3e-c99c-42a1-96e9-de3c325a36dc", "name": "network-vif-plugged", "status": "completed", "tag": "22214f5c-49e6-4040-b1ae-7be35f8961e4"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:19:57.613342 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-e7895ab4-1323-479d-bf14-df655d1ddc5e req-82cb9358-8559-4150-bf56-8e4218c6e94a service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:57.614517 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-e7895ab4-1323-479d-bf14-df655d1ddc5e req-82cb9358-8559-4150-bf56-8e4218c6e94a service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:57.625698 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-e7895ab4-1323-479d-bf14-df655d1ddc5e req-82cb9358-8559-4150-bf56-8e4218c6e94a service nova] Creating event network-vif-plugged:22214f5c-49e6-4040-b1ae-7be35f8961e4 for instance 01cf2a3e-c99c-42a1-96e9-de3c325a36dc on hv-cinder-84214 May 17 17:19:57.630721 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-e7895ab4-1323-479d-bf14-df655d1ddc5e req-82cb9358-8559-4150-bf56-8e4218c6e94a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029723 May 17 17:19:57.631287 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 579/1123] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:19:57.858289 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-77732b71-0b79-48bd-b556-b3e2b3b6c344 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:57.858920 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-77732b71-0b79-48bd-b556-b3e2b3b6c344 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:57.865927 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-77732b71-0b79-48bd-b556-b3e2b3b6c344 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:57.866382 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-77732b71-0b79-48bd-b556-b3e2b3b6c344 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:57.867150 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-77732b71-0b79-48bd-b556-b3e2b3b6c344 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:57.867591 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-77732b71-0b79-48bd-b556-b3e2b3b6c344 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:57.995744 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-77732b71-0b79-48bd-b556-b3e2b3b6c344 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:58.002927 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-77732b71-0b79-48bd-b556-b3e2b3b6c344 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1264 microversion: 2.1 time: 0.148527 May 17 17:19:58.003510 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 545/1124] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:57 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:59.022086 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5c0116ce-29cc-424a-a61a-8841dda08ee9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:59.022782 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5c0116ce-29cc-424a-a61a-8841dda08ee9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:59.028958 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5c0116ce-29cc-424a-a61a-8841dda08ee9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:59.029437 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5c0116ce-29cc-424a-a61a-8841dda08ee9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:59.030194 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5c0116ce-29cc-424a-a61a-8841dda08ee9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:59.030650 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5c0116ce-29cc-424a-a61a-8841dda08ee9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:59.162079 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5c0116ce-29cc-424a-a61a-8841dda08ee9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:59.169308 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5c0116ce-29cc-424a-a61a-8841dda08ee9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1450 microversion: 2.1 time: 0.152953 May 17 17:19:59.169873 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 580/1125] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:59 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:59.185438 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-d940c353-d9c8-4b6d-9fbe-2b81c6f7c39a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:59.186097 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-d940c353-d9c8-4b6d-9fbe-2b81c6f7c39a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:19:59.193541 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d940c353-d9c8-4b6d-9fbe-2b81c6f7c39a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:59.194000 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d940c353-d9c8-4b6d-9fbe-2b81c6f7c39a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:59.194775 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d940c353-d9c8-4b6d-9fbe-2b81c6f7c39a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:59.195223 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-d940c353-d9c8-4b6d-9fbe-2b81c6f7c39a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:59.327861 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-d940c353-d9c8-4b6d-9fbe-2b81c6f7c39a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:19:59.335832 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-d940c353-d9c8-4b6d-9fbe-2b81c6f7c39a tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1450 microversion: 2.1 time: 0.154172 May 17 17:19:59.336399 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 546/1126] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:19:59 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:20:01.108567 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-c2d2e148-496b-4635-9bd0-f4c4c2e9a265 req-59f717d4-a8bd-41e9-8ffc-234763bbe505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01cf2a3e-c99c-42a1-96e9-de3c325a36dc", "tag": "22214f5c-49e6-4040-b1ae-7be35f8961e4"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:20:01.117767 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-c2d2e148-496b-4635-9bd0-f4c4c2e9a265 req-59f717d4-a8bd-41e9-8ffc-234763bbe505 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:20:01.118288 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-c2d2e148-496b-4635-9bd0-f4c4c2e9a265 req-59f717d4-a8bd-41e9-8ffc-234763bbe505 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:20:01.129014 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-c2d2e148-496b-4635-9bd0-f4c4c2e9a265 req-59f717d4-a8bd-41e9-8ffc-234763bbe505 service nova] Creating event network-changed:22214f5c-49e6-4040-b1ae-7be35f8961e4 for instance 01cf2a3e-c99c-42a1-96e9-de3c325a36dc on hv-cinder-84214 May 17 17:20:01.134867 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-c2d2e148-496b-4635-9bd0-f4c4c2e9a265 req-59f717d4-a8bd-41e9-8ffc-234763bbe505 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029955 May 17 17:20:01.135756 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 581/1127] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:20:45.793090 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:20:45.793703 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Tue May 17 17:20:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:21:29.099223 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0a1575ba-d9fc-4c51-b88d-05288c771ac4] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 17 17:21:29.099744 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-572ea4de-ac01-45df-8080-2b74a58b26f8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:29.100125 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-572ea4de-ac01-45df-8080-2b74a58b26f8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:21:29.103807 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-fda7f903-3408-4813-82f7-d4d3a95ff694 req-c698bfa3-8f89-4b64-8f70-d191e021f7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01cf2a3e-c99c-42a1-96e9-de3c325a36dc", "tag": "22214f5c-49e6-4040-b1ae-7be35f8961e4"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:21:29.109754 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-572ea4de-ac01-45df-8080-2b74a58b26f8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:29.110297 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-572ea4de-ac01-45df-8080-2b74a58b26f8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:29.111293 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-572ea4de-ac01-45df-8080-2b74a58b26f8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:29.111905 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-572ea4de-ac01-45df-8080-2b74a58b26f8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:29.114359 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-fda7f903-3408-4813-82f7-d4d3a95ff694 req-c698bfa3-8f89-4b64-8f70-d191e021f7b0 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:29.114991 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-fda7f903-3408-4813-82f7-d4d3a95ff694 req-c698bfa3-8f89-4b64-8f70-d191e021f7b0 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:29.129723 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-fda7f903-3408-4813-82f7-d4d3a95ff694 req-c698bfa3-8f89-4b64-8f70-d191e021f7b0 service nova] Creating event network-changed:22214f5c-49e6-4040-b1ae-7be35f8961e4 for instance 01cf2a3e-c99c-42a1-96e9-de3c325a36dc on hv-cinder-84214 May 17 17:21:29.138891 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-fda7f903-3408-4813-82f7-d4d3a95ff694 req-c698bfa3-8f89-4b64-8f70-d191e021f7b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041565 May 17 17:21:29.140370 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 582/1128] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:21:29.152345 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-572ea4de-ac01-45df-8080-2b74a58b26f8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Going to try to terminate instance {{(pid=117089) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:21:29.249622 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-572ea4de-ac01-45df-8080-2b74a58b26f8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "DELETE /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 204 len: 0 microversion: 2.1 time: 0.154851 May 17 17:21:29.250691 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 547/1129] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:21:29 2022] DELETE /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:21:29.260144 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7508ccc9-830b-4a35-a662-09645629c77d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:29.260849 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7508ccc9-830b-4a35-a662-09645629c77d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:21:29.268283 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7508ccc9-830b-4a35-a662-09645629c77d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:29.269528 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7508ccc9-830b-4a35-a662-09645629c77d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:29.270310 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7508ccc9-830b-4a35-a662-09645629c77d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:29.270741 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7508ccc9-830b-4a35-a662-09645629c77d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:29.550342 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-7508ccc9-830b-4a35-a662-09645629c77d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:21:29.558423 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7508ccc9-830b-4a35-a662-09645629c77d tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1575 microversion: 2.1 time: 0.303242 May 17 17:21:29.559095 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 583/1130] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:21:29 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1575 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:21:30.576835 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-ad05a9ae-ceab-486f-a6bc-20461fddee1b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:30.577545 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-ad05a9ae-ceab-486f-a6bc-20461fddee1b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:21:30.583977 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ad05a9ae-ceab-486f-a6bc-20461fddee1b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:30.584439 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ad05a9ae-ceab-486f-a6bc-20461fddee1b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:30.585220 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ad05a9ae-ceab-486f-a6bc-20461fddee1b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:30.585914 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-ad05a9ae-ceab-486f-a6bc-20461fddee1b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:30.769207 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-ad05a9ae-ceab-486f-a6bc-20461fddee1b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:21:30.776847 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-ad05a9ae-ceab-486f-a6bc-20461fddee1b tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1575 microversion: 2.1 time: 0.204303 May 17 17:21:30.777417 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 548/1131] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:21:30 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:21:31.544264 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO oslo.messaging._drivers.impl_rabbit [-] [0a1575ba-d9fc-4c51-b88d-05288c771ac4] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 46468. May 17 17:21:31.594393 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-035d10b1-9b61-4b99-b5c7-2f3d30db8d80 req-527120e8-855c-42a6-8111-9569bf3d95af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01cf2a3e-c99c-42a1-96e9-de3c325a36dc", "name": "network-vif-deleted", "tag": "22214f5c-49e6-4040-b1ae-7be35f8961e4"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:21:31.602393 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-035d10b1-9b61-4b99-b5c7-2f3d30db8d80 req-527120e8-855c-42a6-8111-9569bf3d95af service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:31.602840 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-035d10b1-9b61-4b99-b5c7-2f3d30db8d80 req-527120e8-855c-42a6-8111-9569bf3d95af service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:31.613634 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-035d10b1-9b61-4b99-b5c7-2f3d30db8d80 req-527120e8-855c-42a6-8111-9569bf3d95af service nova] Creating event network-vif-deleted:22214f5c-49e6-4040-b1ae-7be35f8961e4 for instance 01cf2a3e-c99c-42a1-96e9-de3c325a36dc on hv-cinder-84214 May 17 17:21:31.618288 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-035d10b1-9b61-4b99-b5c7-2f3d30db8d80 req-527120e8-855c-42a6-8111-9569bf3d95af service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091136 May 17 17:21:31.619086 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 584/1132] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:21:31.795592 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-89c4523b-7f87-4319-a27b-cd4d4bebd2e8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:31.796286 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-89c4523b-7f87-4319-a27b-cd4d4bebd2e8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:21:31.803096 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-89c4523b-7f87-4319-a27b-cd4d4bebd2e8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:31.803564 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-89c4523b-7f87-4319-a27b-cd4d4bebd2e8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:31.804400 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-89c4523b-7f87-4319-a27b-cd4d4bebd2e8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:31.805132 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-89c4523b-7f87-4319-a27b-cd4d4bebd2e8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:31.871596 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-89c4523b-7f87-4319-a27b-cd4d4bebd2e8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:21:31.880575 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-89c4523b-7f87-4319-a27b-cd4d4bebd2e8 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 200 len: 1224 microversion: 2.1 time: 0.089317 May 17 17:21:31.881282 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 549/1133] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:21:31 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:21:32.899584 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-dfbf725c-ac47-445a-b65a-cbf878446b54 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:32.900301 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-dfbf725c-ac47-445a-b65a-cbf878446b54 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 01cf2a3e-c99c-42a1-96e9-de3c325a36dc] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:21:32.907222 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dfbf725c-ac47-445a-b65a-cbf878446b54 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:32.907701 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dfbf725c-ac47-445a-b65a-cbf878446b54 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:32.908460 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dfbf725c-ac47-445a-b65a-cbf878446b54 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:32.908911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-dfbf725c-ac47-445a-b65a-cbf878446b54 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:32.922412 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-dfbf725c-ac47-445a-b65a-cbf878446b54 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] HTTP exception thrown: Instance 01cf2a3e-c99c-42a1-96e9-de3c325a36dc could not be found. May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-dfbf725c-ac47-445a-b65a-cbf878446b54 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Request method failure captured: May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc HTTP/1.1 May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9f5thZO438wSlY1p3r4IvV9x5LqPi5FFcFh7EEqTOFHIztCDNXqF8L6W_gcRmRZCfqpaTXP2--sj5apxSlSfDr-kBabsSX_-5vIsxSpQ7-pyPE_qxddDUwcgHX23FoQZ3ND43OIxwVT-6vFsSo9Y4r_b3I84nC70r_nGMpXaFOvvfE May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: b1528992e3c74c08b5c4192466f23852 May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-TestVolumeBootPattern-2122050549 May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:21:32.924159 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:21:32.925954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b1528992e3c74c08b5c4192466f23852"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:21:32.925954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-TestVolumeBootPattern-2122050549 May 17 17:21:32.925954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: b1528992e3c74c08b5c4192466f23852 May 17 17:21:32.925954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122050549 May 17 17:21:32.925954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-TestVolumeBootPattern-2122050549-project May 17 17:21:32.925954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:21:32.925954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:21:32.925954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 38bdb5f8e08e49358f9f27e4f1ce167b May 17 17:21:32.925954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-TestVolumeBootPattern-2122050549-project May 17 17:21:32.925954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:21:32.925954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance 01cf2a3e-c99c-42a1-96e9-de3c325a36dc could not be found. May 17 17:21:32.925954 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '01cf2a3e-c99c-42a1-96e9-de3c325a36dc'} May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01cf2a3e-c99c-42a1-96e9-de3c325a36dc could not be found. May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:21:32.926896 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01cf2a3e-c99c-42a1-96e9-de3c325a36dc could not be found. May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01cf2a3e-c99c-42a1-96e9-de3c325a36dc could not be found. May 17 17:21:32.928572 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:32.930308 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-dfbf725c-ac47-445a-b65a-cbf878446b54 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Returning 404 to user: Instance 01cf2a3e-c99c-42a1-96e9-de3c325a36dc could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:21:32.930308 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-dfbf725c-ac47-445a-b65a-cbf878446b54 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc" status: 404 len: 111 microversion: 2.1 time: 0.030530 May 17 17:21:32.930308 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 585/1134] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:21:32 2022] GET /compute/v2.1/servers/01cf2a3e-c99c-42a1-96e9-de3c325a36dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:21:35.993639 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-0278d497-8e3a-463a-aa4f-0cafa7d441a9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:35.994455 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0278d497-8e3a-463a-aa4f-0cafa7d441a9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:21:35.995895 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-dfb2fe66-6246-46b1-a66f-9ee34c2e42a2 req-f3fa21a5-5ccc-48aa-a967-fb3c8e60e71d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82812c49-fa86-43cc-ab6f-2df6bf74dfd8", "tag": "69a028cd-6a7e-49ed-93d6-e5229bb69b2c"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:21:36.001441 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0278d497-8e3a-463a-aa4f-0cafa7d441a9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:36.001981 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0278d497-8e3a-463a-aa4f-0cafa7d441a9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:36.002837 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0278d497-8e3a-463a-aa4f-0cafa7d441a9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:36.003351 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-0278d497-8e3a-463a-aa4f-0cafa7d441a9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:36.006042 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-dfb2fe66-6246-46b1-a66f-9ee34c2e42a2 req-f3fa21a5-5ccc-48aa-a967-fb3c8e60e71d service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:36.006558 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-dfb2fe66-6246-46b1-a66f-9ee34c2e42a2 req-f3fa21a5-5ccc-48aa-a967-fb3c8e60e71d service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:36.018929 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-dfb2fe66-6246-46b1-a66f-9ee34c2e42a2 req-f3fa21a5-5ccc-48aa-a967-fb3c8e60e71d service nova] Creating event network-changed:69a028cd-6a7e-49ed-93d6-e5229bb69b2c for instance 82812c49-fa86-43cc-ab6f-2df6bf74dfd8 on hv-cinder-84214 May 17 17:21:36.024889 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-dfb2fe66-6246-46b1-a66f-9ee34c2e42a2 req-f3fa21a5-5ccc-48aa-a967-fb3c8e60e71d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032593 May 17 17:21:36.025847 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 586/1135] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:21:36.030190 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-0278d497-8e3a-463a-aa4f-0cafa7d441a9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Going to try to terminate instance {{(pid=117089) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:21:36.136894 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-0278d497-8e3a-463a-aa4f-0cafa7d441a9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "DELETE /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 204 len: 0 microversion: 2.1 time: 0.146544 May 17 17:21:36.141728 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 550/1136] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:21:35 2022] DELETE /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:21:36.146963 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-5437353d-fe91-466d-823d-ebff33aef1ea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:36.147744 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-5437353d-fe91-466d-823d-ebff33aef1ea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:21:36.154810 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5437353d-fe91-466d-823d-ebff33aef1ea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:36.155265 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5437353d-fe91-466d-823d-ebff33aef1ea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:36.156071 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5437353d-fe91-466d-823d-ebff33aef1ea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:36.156506 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-5437353d-fe91-466d-823d-ebff33aef1ea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:36.295239 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.policy [None req-5437353d-fe91-466d-823d-ebff33aef1ea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117090) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:21:36.305986 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-5437353d-fe91-466d-823d-ebff33aef1ea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1577 microversion: 2.1 time: 0.163371 May 17 17:21:36.306577 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 587/1137] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:21:36 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:21:37.324163 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-2c915450-e8c8-41a4-89f7-efbb1b08e62e tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:37.325104 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-2c915450-e8c8-41a4-89f7-efbb1b08e62e tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:21:37.331431 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2c915450-e8c8-41a4-89f7-efbb1b08e62e tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:37.331920 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2c915450-e8c8-41a4-89f7-efbb1b08e62e tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:37.332693 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2c915450-e8c8-41a4-89f7-efbb1b08e62e tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:37.333127 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-2c915450-e8c8-41a4-89f7-efbb1b08e62e tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:37.469126 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-2c915450-e8c8-41a4-89f7-efbb1b08e62e tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:21:37.476440 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-2c915450-e8c8-41a4-89f7-efbb1b08e62e tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1577 microversion: 2.1 time: 0.156806 May 17 17:21:37.476996 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 551/1138] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:21:37 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:21:38.039927 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [req-32f376e2-02ac-4855-9fd9-cdf5a822e8dc req-d6efc826-f312-45cd-967b-6f6e94488a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82812c49-fa86-43cc-ab6f-2df6bf74dfd8", "name": "network-vif-deleted", "tag": "69a028cd-6a7e-49ed-93d6-e5229bb69b2c"}]} {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:21:38.048666 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-32f376e2-02ac-4855-9fd9-cdf5a822e8dc req-d6efc826-f312-45cd-967b-6f6e94488a03 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:38.049188 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [req-32f376e2-02ac-4855-9fd9-cdf5a822e8dc req-d6efc826-f312-45cd-967b-6f6e94488a03 service nova] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:38.061068 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.compute.server_external_events [req-32f376e2-02ac-4855-9fd9-cdf5a822e8dc req-d6efc826-f312-45cd-967b-6f6e94488a03 service nova] Creating event network-vif-deleted:69a028cd-6a7e-49ed-93d6-e5229bb69b2c for instance 82812c49-fa86-43cc-ab6f-2df6bf74dfd8 on hv-cinder-84214 May 17 17:21:38.065862 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [req-32f376e2-02ac-4855-9fd9-cdf5a822e8dc req-d6efc826-f312-45cd-967b-6f6e94488a03 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030021 May 17 17:21:38.066448 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 588/1139] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 17 17:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:21:38.494180 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-a02fe1ea-1348-482b-a42a-61259e292624 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:38.494808 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-a02fe1ea-1348-482b-a42a-61259e292624 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:21:38.502222 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a02fe1ea-1348-482b-a42a-61259e292624 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:38.502680 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a02fe1ea-1348-482b-a42a-61259e292624 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:38.503456 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a02fe1ea-1348-482b-a42a-61259e292624 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:38.503929 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a02fe1ea-1348-482b-a42a-61259e292624 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:38.537384 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a02fe1ea-1348-482b-a42a-61259e292624 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:38.537844 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-a02fe1ea-1348-482b-a42a-61259e292624 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:38.538396 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.objects.instance [None req-a02fe1ea-1348-482b-a42a-61259e292624 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lazy-loading 'fault' on Instance uuid 82812c49-fa86-43cc-ab6f-2df6bf74dfd8 {{(pid=117089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:21:38.581016 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.policy [None req-a02fe1ea-1348-482b-a42a-61259e292624 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bdb5f8e08e49358f9f27e4f1ce167b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528992e3c74c08b5c4192466f23852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117089) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:21:38.588409 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-a02fe1ea-1348-482b-a42a-61259e292624 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 200 len: 1230 microversion: 2.1 time: 0.098262 May 17 17:21:38.589048 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 552/1140] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:21:38 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:21:39.608007 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7c51fa92-353f-4448-9376-fcfce0532bea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:39.608736 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-7c51fa92-353f-4448-9376-fcfce0532bea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 82812c49-fa86-43cc-ab6f-2df6bf74dfd8] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:21:39.614865 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7c51fa92-353f-4448-9376-fcfce0532bea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:39.615312 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7c51fa92-353f-4448-9376-fcfce0532bea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:39.616101 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7c51fa92-353f-4448-9376-fcfce0532bea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:39.616539 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-7c51fa92-353f-4448-9376-fcfce0532bea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:39.630329 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-7c51fa92-353f-4448-9376-fcfce0532bea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] HTTP exception thrown: Instance 82812c49-fa86-43cc-ab6f-2df6bf74dfd8 could not be found. May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7c51fa92-353f-4448-9376-fcfce0532bea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Request method failure captured: May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 HTTP/1.1 May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9f5thZO438wSlY1p3r4IvV9x5LqPi5FFcFh7EEqTOFHIztCDNXqF8L6W_gcRmRZCfqpaTXP2--sj5apxSlSfDr-kBabsSX_-5vIsxSpQ7-pyPE_qxddDUwcgHX23FoQZ3ND43OIxwVT-6vFsSo9Y4r_b3I84nC70r_nGMpXaFOvvfE May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: b1528992e3c74c08b5c4192466f23852 May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-TestVolumeBootPattern-2122050549 May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:21:39.632347 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:21:39.633931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b1528992e3c74c08b5c4192466f23852"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:21:39.633931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-TestVolumeBootPattern-2122050549 May 17 17:21:39.633931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: b1528992e3c74c08b5c4192466f23852 May 17 17:21:39.633931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122050549 May 17 17:21:39.633931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-TestVolumeBootPattern-2122050549-project May 17 17:21:39.633931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:21:39.633931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:21:39.633931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 38bdb5f8e08e49358f9f27e4f1ce167b May 17 17:21:39.633931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-TestVolumeBootPattern-2122050549-project May 17 17:21:39.633931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:21:39.633931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance 82812c49-fa86-43cc-ab6f-2df6bf74dfd8 could not be found. May 17 17:21:39.633931 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '82812c49-fa86-43cc-ab6f-2df6bf74dfd8'} May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82812c49-fa86-43cc-ab6f-2df6bf74dfd8 could not be found. May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:21:39.634934 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82812c49-fa86-43cc-ab6f-2df6bf74dfd8 could not be found. May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82812c49-fa86-43cc-ab6f-2df6bf74dfd8 could not be found. May 17 17:21:39.636540 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:39.638329 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-7c51fa92-353f-4448-9376-fcfce0532bea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Returning 404 to user: Instance 82812c49-fa86-43cc-ab6f-2df6bf74dfd8 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:21:39.638329 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-7c51fa92-353f-4448-9376-fcfce0532bea tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8" status: 404 len: 111 microversion: 2.1 time: 0.031462 May 17 17:21:39.638329 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 589/1141] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:21:39 2022] GET /compute/v2.1/servers/82812c49-fa86-43cc-ab6f-2df6bf74dfd8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:21:40.059328 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-43a1f283-273c-4c75-a9ed-b65edbd5e8be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:40.059944 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.compute.api [None req-43a1f283-273c-4c75-a9ed-b65edbd5e8be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117089) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:21:40.066172 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-43a1f283-273c-4c75-a9ed-b65edbd5e8be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:40.066617 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-43a1f283-273c-4c75-a9ed-b65edbd5e8be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:40.067378 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-43a1f283-273c-4c75-a9ed-b65edbd5e8be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:40.067851 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG oslo_concurrency.lockutils [None req-43a1f283-273c-4c75-a9ed-b65edbd5e8be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:40.081434 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.wsgi [None req-43a1f283-273c-4c75-a9ed-b65edbd5e8be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] HTTP exception thrown: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-43a1f283-273c-4c75-a9ed-b65edbd5e8be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Request method failure captured: May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: request: DELETE /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 HTTP/1.1 May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept: application/json May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Accept-Encoding: identity May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Connection: close May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Length: 0 May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Content-Type: application/json May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Host: 10.222.0.48 May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Openstack-System-Scope: None May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: User-Agent: python-urllib3/1.26.9 May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Auth-Token: gAAAAABig9f5thZO438wSlY1p3r4IvV9x5LqPi5FFcFh7EEqTOFHIztCDNXqF8L6W_gcRmRZCfqpaTXP2--sj5apxSlSfDr-kBabsSX_-5vIsxSpQ7-pyPE_qxddDUwcgHX23FoQZ3ND43OIxwVT-6vFsSo9Y4r_b3I84nC70r_nGMpXaFOvvfE May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Id: None May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Domain-Name: None May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Identity-Status: Confirmed May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Is-Admin-Project: True May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Id: default May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Domain-Name: Default May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Id: b1528992e3c74c08b5c4192466f23852 May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Project-Name: tempest-TestVolumeBootPattern-2122050549 May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Role: member,reader May 17 17:21:40.083080 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Roles: member,reader May 17 17:21:40.084928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b1528992e3c74c08b5c4192466f23852"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:21:40.084928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant: tempest-TestVolumeBootPattern-2122050549 May 17 17:21:40.084928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Id: b1528992e3c74c08b5c4192466f23852 May 17 17:21:40.084928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122050549 May 17 17:21:40.084928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User: tempest-TestVolumeBootPattern-2122050549-project May 17 17:21:40.084928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Id: default May 17 17:21:40.084928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Domain-Name: Default May 17 17:21:40.084928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Id: 38bdb5f8e08e49358f9f27e4f1ce167b May 17 17:21:40.084928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: X-User-Name: tempest-TestVolumeBootPattern-2122050549-project May 17 17:21:40.084928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: method: > May 17 17:21:40.084928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: exception: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:21:40.084928 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: action_args: {'id': '50898191-2e63-45d2-85bb-e47d9fe6d844'} May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:21:40.086003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:21:40.092112 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: ERROR nova.api.openstack.wsgi May 17 17:21:40.093647 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-43a1f283-273c-4c75-a9ed-b65edbd5e8be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Returning 404 to user: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. {{(pid=117089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:21:40.093647 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-43a1f283-273c-4c75-a9ed-b65edbd5e8be tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "DELETE /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 404 len: 111 microversion: 2.1 time: 0.029450 May 17 17:21:40.093647 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 553/1142] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 17 17:21:40 2022] DELETE /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:21:40.096936 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-220fb8e1-7e19-4f85-b642-ea448db21d08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '>' {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:40.097573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.compute.api [None req-220fb8e1-7e19-4f85-b642-ea448db21d08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] [instance: 50898191-2e63-45d2-85bb-e47d9fe6d844] Fetching instance by UUID {{(pid=117090) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:21:40.103435 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-220fb8e1-7e19-4f85-b642-ea448db21d08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:40.103926 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-220fb8e1-7e19-4f85-b642-ea448db21d08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:40.104688 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-220fb8e1-7e19-4f85-b642-ea448db21d08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:40.105121 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG oslo_concurrency.lockutils [None req-220fb8e1-7e19-4f85-b642-ea448db21d08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Lock "d5cb3f3d-542a-485b-8bb4-94fae1d56923" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:40.118245 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.wsgi [None req-220fb8e1-7e19-4f85-b642-ea448db21d08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] HTTP exception thrown: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-220fb8e1-7e19-4f85-b642-ea448db21d08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Request method failure captured: May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: request: GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 HTTP/1.1 May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept: application/json May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Accept-Encoding: identity May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Connection: close May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Length: 0 May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Content-Type: application/json May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Host: 10.222.0.48 May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Openstack-System-Scope: None May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: User-Agent: python-urllib3/1.26.9 May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Auth-Token: gAAAAABig9f5thZO438wSlY1p3r4IvV9x5LqPi5FFcFh7EEqTOFHIztCDNXqF8L6W_gcRmRZCfqpaTXP2--sj5apxSlSfDr-kBabsSX_-5vIsxSpQ7-pyPE_qxddDUwcgHX23FoQZ3ND43OIxwVT-6vFsSo9Y4r_b3I84nC70r_nGMpXaFOvvfE May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Id: None May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Domain-Name: None May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Identity-Status: Confirmed May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Is-Admin-Project: True May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Id: default May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Domain-Name: Default May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Id: b1528992e3c74c08b5c4192466f23852 May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Project-Name: tempest-TestVolumeBootPattern-2122050549 May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Role: member,reader May 17 17:21:40.119870 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Roles: member,reader May 17 17:21:40.121573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b1528992e3c74c08b5c4192466f23852"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1528992e3c74c08b5c4192466f23852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] May 17 17:21:40.121573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant: tempest-TestVolumeBootPattern-2122050549 May 17 17:21:40.121573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Id: b1528992e3c74c08b5c4192466f23852 May 17 17:21:40.121573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-Tenant-Name: tempest-TestVolumeBootPattern-2122050549 May 17 17:21:40.121573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User: tempest-TestVolumeBootPattern-2122050549-project May 17 17:21:40.121573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Id: default May 17 17:21:40.121573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Domain-Name: Default May 17 17:21:40.121573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Id: 38bdb5f8e08e49358f9f27e4f1ce167b May 17 17:21:40.121573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: X-User-Name: tempest-TestVolumeBootPattern-2122050549-project May 17 17:21:40.121573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: method: > May 17 17:21:40.121573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: exception: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:21:40.121573 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: action_args: {'id': '50898191-2e63-45d2-85bb-e47d9fe6d844'} May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: {{(pid=117090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:21:40.122614 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. May 17 17:21:40.123911 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: ERROR nova.api.openstack.wsgi May 17 17:21:40.125382 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: DEBUG nova.api.openstack.wsgi [None req-220fb8e1-7e19-4f85-b642-ea448db21d08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Returning 404 to user: Instance 50898191-2e63-45d2-85bb-e47d9fe6d844 could not be found. {{(pid=117090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:21:40.125382 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO nova.api.openstack.requestlog [None req-220fb8e1-7e19-4f85-b642-ea448db21d08 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844" status: 404 len: 111 microversion: 2.1 time: 0.028086 May 17 17:21:40.125382 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: [pid: 117090|app: 0|req: 590/1143] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 17 17:21:40 2022] GET /compute/v2.1/servers/50898191-2e63-45d2-85bb-e47d9fe6d844 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:21:41.404745 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: DEBUG nova.api.openstack.wsgi [None req-7e7ca025-56ce-496e-8bdf-115fe92e43b9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] Calling method '.version_select at 0x7feb18158280>' {{(pid=117089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:41.427290 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO nova.api.openstack.requestlog [None req-7e7ca025-56ce-496e-8bdf-115fe92e43b9 tempest-TestVolumeBootPattern-2122050549 tempest-TestVolumeBootPattern-2122050549-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-402373830" status: 202 len: 0 microversion: 2.1 time: 0.026698 May 17 17:21:41.431003 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: [pid: 117089|app: 0|req: 554/1144] 10.222.0.48 () {58 vars in 1259 bytes} [Tue May 17 17:21:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-402373830 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:22:25.984424 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:22:25.984926 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Tue May 17 17:22:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:24:05.801427 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:24:05.802036 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Tue May 17 17:24:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:24:09.379838 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:24:09.380417 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Tue May 17 17:24:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:24:14.577483 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:24:14.578121 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Tue May 17 17:24:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:25:25.992970 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:25:25.993586 dv-cinder-842149-1-iscsi devstack@n-api.service[117089]: Tue May 17 17:25:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:25:31.028940 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:25:31.029564 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Tue May 17 17:25:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:25:45.992666 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:25:45.993418 dv-cinder-842149-1-iscsi devstack@n-api.service[117090]: Tue May 17 17:25:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!